Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
2026-05-02T20:00:26Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-05-02T20:00:26Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskpeoj1k/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskpeoj1k/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/security.properties
2026-05-02 20:00:34: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskpeoj1k/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskpeoj1k/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260502 20:00:42.505429 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.190:46101
--webserver_interface=127.10.27.190
--webserver_port=0
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 20:00:42.621400 10633 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:00:42.621645 10633 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:00:42.621685 10633 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:00:42.625852 10633 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 20:00:42.625914 10633 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:00:42.625936 10633 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 20:00:42.625953 10633 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 20:00:42.630021 10633 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.190:46101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.27.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.10633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:00:42.631210 10633 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:00:42.632339 10633 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:00:42.638106 10639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:42.638162 10641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:42.638209 10638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:00:42.638384 10633 server_base.cc:1061] running on GCE node
I20260502 20:00:42.638839 10633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:00:42.639786 10633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:00:42.640944 10633 hybrid_clock.cc:648] HybridClock initialized: now 1777752042640930 us; error 27 us; skew 500 ppm
I20260502 20:00:42.642817 10633 webserver.cc:492] Webserver started at http://127.10.27.190:38717/ using document root <none> and password file <none>
I20260502 20:00:42.643430 10633 fs_manager.cc:362] Metadata directory not provided
I20260502 20:00:42.643486 10633 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:00:42.643698 10633 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260502 20:00:42.645256 10633 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data/instance:
uuid: "38315e4f56484666b5e54afad02498ec"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:00:42.645743 10633 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal/instance:
uuid: "38315e4f56484666b5e54afad02498ec"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:00:42.649113 10633 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260502 20:00:42.651378 10647 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:42.652628 10633 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260502 20:00:42.652727 10633 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
uuid: "38315e4f56484666b5e54afad02498ec"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:00:42.652916 10633 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:00:42.668268 10633 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:00:42.668962 10633 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:00:42.669178 10633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:00:42.676229 10633 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.190:46101
I20260502 20:00:42.676235 10699 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.190:46101 every 8 connection(s)
I20260502 20:00:42.677270 10633 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data/info.pb
I20260502 20:00:42.680181 10700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:42.682578 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 10633
I20260502 20:00:42.682758 10350 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal/instance
I20260502 20:00:42.683977 10700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } has no permanent_uuid. Determining permanent_uuid...
I20260502 20:00:42.684543 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.189:46281
--webserver_interface=127.10.27.189
--webserver_port=0
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260502 20:00:42.700497 10700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } has no permanent_uuid. Determining permanent_uuid...
W20260502 20:00:42.701305 10648 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:00:42.702188 10700 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.27.189:46281: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:00:42.751487 10700 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } attempt: 1
W20260502 20:00:42.753222 10700 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.27.189:46281: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:00:42.791302 10701 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:00:42.791536 10701 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:00:42.791577 10701 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:00:42.795059 10701 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 20:00:42.795128 10701 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:00:42.795149 10701 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 20:00:42.795167 10701 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 20:00:42.799216 10701 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.189:46281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.27.189
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.10701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:00:42.800438 10701 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:00:42.801627 10701 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:00:42.807523 10712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:42.807719 10710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:42.807523 10709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:00:42.807896 10701 server_base.cc:1061] running on GCE node
I20260502 20:00:42.808483 10701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:00:42.809505 10701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:00:42.810707 10701 hybrid_clock.cc:648] HybridClock initialized: now 1777752042810694 us; error 36 us; skew 500 ppm
I20260502 20:00:42.812741 10701 webserver.cc:492] Webserver started at http://127.10.27.189:43275/ using document root <none> and password file <none>
I20260502 20:00:42.813328 10701 fs_manager.cc:362] Metadata directory not provided
I20260502 20:00:42.813410 10701 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:00:42.813632 10701 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260502 20:00:42.815214 10701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/instance:
uuid: "ef9294b460014382a2a594c77f8900d4"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:00:42.815677 10701 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal/instance:
uuid: "ef9294b460014382a2a594c77f8900d4"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:00:42.818899 10701 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260502 20:00:42.821453 10700 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } attempt: 2
I20260502 20:00:42.821691 10718 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:42.822834 10701 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260502 20:00:42.822990 10701 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
uuid: "ef9294b460014382a2a594c77f8900d4"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
W20260502 20:00:42.823083 10700 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.27.189:46281: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:00:42.823115 10701 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:00:42.833289 10701 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:00:42.833858 10701 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:00:42.833998 10701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:00:42.841388 10701 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.189:46281
I20260502 20:00:42.841408 10770 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.189:46281 every 8 connection(s)
I20260502 20:00:42.842429 10701 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
I20260502 20:00:42.845211 10771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:42.848605 10771 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } has no permanent_uuid. Determining permanent_uuid...
I20260502 20:00:42.851315 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 10701
I20260502 20:00:42.851434 10350 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal/instance
I20260502 20:00:42.852133 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.188:33369
--webserver_interface=127.10.27.188
--webserver_port=0
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260502 20:00:42.858457 10771 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } has no permanent_uuid. Determining permanent_uuid...
I20260502 20:00:42.866086 10771 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } has no permanent_uuid. Determining permanent_uuid...
W20260502 20:00:42.867036 10721 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
W20260502 20:00:42.867977 10771 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.27.188:33369: Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
I20260502 20:00:42.914278 10700 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } attempt: 3
I20260502 20:00:42.917224 10771 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } attempt: 1
W20260502 20:00:42.918969 10771 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.27.188:33369: Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
I20260502 20:00:42.919294 10700 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } has no permanent_uuid. Determining permanent_uuid...
W20260502 20:00:42.920666 10700 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.27.188:33369: Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
I20260502 20:00:42.951815 10700 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } attempt: 1
W20260502 20:00:42.953388 10700 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.27.188:33369: Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
W20260502 20:00:42.966312 10773 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:00:42.966629 10773 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:00:42.966759 10773 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:00:42.970530 10773 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 20:00:42.970593 10773 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:00:42.970614 10773 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 20:00:42.970633 10773 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 20:00:42.974592 10773 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.188:33369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.27.188
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.10773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:00:42.975658 10773 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:00:42.976819 10773 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:00:42.982534 10780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:42.982539 10783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:42.982561 10781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:00:42.982791 10773 server_base.cc:1061] running on GCE node
I20260502 20:00:42.983331 10773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:00:42.984238 10773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:00:42.985430 10773 hybrid_clock.cc:648] HybridClock initialized: now 1777752042985397 us; error 44 us; skew 500 ppm
I20260502 20:00:42.987147 10771 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } attempt: 2
I20260502 20:00:42.987519 10773 webserver.cc:492] Webserver started at http://127.10.27.188:35669/ using document root <none> and password file <none>
I20260502 20:00:42.988209 10773 fs_manager.cc:362] Metadata directory not provided
I20260502 20:00:42.988298 10773 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:00:42.988543 10773 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
W20260502 20:00:42.988775 10771 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.27.188:33369: Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
I20260502 20:00:42.990144 10773 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/instance:
uuid: "b470a66ad54f46b1b44a80dd1edf214e"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:00:42.990566 10773 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal/instance:
uuid: "b470a66ad54f46b1b44a80dd1edf214e"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:00:42.993796 10773 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260502 20:00:42.996301 10789 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:42.997419 10773 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260502 20:00:42.997522 10773 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
uuid: "b470a66ad54f46b1b44a80dd1edf214e"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:00:42.997601 10773 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:00:43.009531 10773 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:00:43.010165 10773 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:00:43.010315 10773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:00:43.017921 10841 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.188:33369 every 8 connection(s)
I20260502 20:00:43.017935 10773 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.188:33369
I20260502 20:00:43.019146 10773 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
I20260502 20:00:43.022096 10842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:43.025611 10842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } has no permanent_uuid. Determining permanent_uuid...
I20260502 20:00:43.027981 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 10773
I20260502 20:00:43.028110 10350 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal/instance
I20260502 20:00:43.028550 10700 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } attempt: 2
I20260502 20:00:43.036159 10842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } has no permanent_uuid. Determining permanent_uuid...
I20260502 20:00:43.038836 10700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Bootstrap starting.
I20260502 20:00:43.040868 10842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } has no permanent_uuid. Determining permanent_uuid...
I20260502 20:00:43.041661 10700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:43.042449 10700 log.cc:826] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Log is configured to *not* fsync() on all Append() calls
I20260502 20:00:43.045011 10700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: No bootstrap required, opened a new log
I20260502 20:00:43.048782 10842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Bootstrap starting.
I20260502 20:00:43.048816 10700 raft_consensus.cc:359] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:43.049027 10700 raft_consensus.cc:385] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:43.049095 10700 raft_consensus.cc:740] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38315e4f56484666b5e54afad02498ec, State: Initialized, Role: FOLLOWER
I20260502 20:00:43.049508 10700 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:43.050045 10850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:43.050190 10850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:43.050671 10700 sys_catalog.cc:565] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: configured and running, proceeding with master startup.
I20260502 20:00:43.051358 10842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:43.052273 10842 log.cc:826] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Log is configured to *not* fsync() on all Append() calls
I20260502 20:00:43.054368 10842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: No bootstrap required, opened a new log
I20260502 20:00:43.057956 10842 raft_consensus.cc:359] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
W20260502 20:00:43.058187 10865 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260502 20:00:43.058287 10865 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260502 20:00:43.058249 10842 raft_consensus.cc:385] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:43.058406 10842 raft_consensus.cc:740] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b470a66ad54f46b1b44a80dd1edf214e, State: Initialized, Role: FOLLOWER
I20260502 20:00:43.058995 10842 consensus_queue.cc:260] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:43.061100 10842 sys_catalog.cc:565] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: configured and running, proceeding with master startup.
I20260502 20:00:43.059811 10633 master_runner.cc:186] Error getting master registration for 127.10.27.189:46281: OK, instance_id { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" instance_seqno: 1777752042839156 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260502 20:00:43.062112 10633 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:00:43.068995 10882 catalog_manager.cc:1568] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260502 20:00:43.069227 10882 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260502 20:00:43.069461 10868 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:43.069689 10868 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:43.068413 10773 master_runner.cc:186] Error getting master registration for 127.10.27.189:46281: OK, instance_id { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" instance_seqno: 1777752042839156 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260502 20:00:43.070695 10773 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:00:43.079960 10771 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } attempt: 3
I20260502 20:00:43.087926 10771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Bootstrap starting.
I20260502 20:00:43.090014 10868 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:43.090168 10868 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:43.091212 10868 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
I20260502 20:00:43.092725 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b470a66ad54f46b1b44a80dd1edf214e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38315e4f56484666b5e54afad02498ec" is_pre_election: true
I20260502 20:00:43.092984 10674 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b470a66ad54f46b1b44a80dd1edf214e in term 0.
I20260502 20:00:43.093729 10791 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e; no voters:
I20260502 20:00:43.094508 10868 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:43.094580 10868 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:43.094622 10868 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:43.095736 10868 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:43.096086 10868 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 1 election: Requested vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
I20260502 20:00:43.097018 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b470a66ad54f46b1b44a80dd1edf214e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38315e4f56484666b5e54afad02498ec"
I20260502 20:00:43.097136 10674 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:43.098217 10674 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b470a66ad54f46b1b44a80dd1edf214e in term 1.
I20260502 20:00:43.098697 10791 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e; no voters:
I20260502 20:00:43.098974 10868 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:43.099182 10868 raft_consensus.cc:697] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 1 LEADER]: Becoming Leader. State: Replica: b470a66ad54f46b1b44a80dd1edf214e, State: Running, Role: LEADER
I20260502 20:00:43.099511 10868 consensus_queue.cc:237] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:43.110324 10771 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:43.110356 10868 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b470a66ad54f46b1b44a80dd1edf214e. Latest consensus state: current_term: 1 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:43.111019 10868 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:43.113440 10771 log.cc:826] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Log is configured to *not* fsync() on all Append() calls
I20260502 20:00:43.117120 10887 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 20:00:43.121891 10887 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 20:00:43.125566 10771 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: No bootstrap required, opened a new log
I20260502 20:00:43.131112 10771 raft_consensus.cc:359] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:43.131608 10771 raft_consensus.cc:385] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:43.131788 10771 raft_consensus.cc:740] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9294b460014382a2a594c77f8900d4, State: Initialized, Role: FOLLOWER
I20260502 20:00:43.132817 10771 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:43.136747 10745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b470a66ad54f46b1b44a80dd1edf214e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9294b460014382a2a594c77f8900d4" is_pre_election: true
I20260502 20:00:43.137033 10745 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b470a66ad54f46b1b44a80dd1edf214e in term 0.
I20260502 20:00:43.137820 10744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b470a66ad54f46b1b44a80dd1edf214e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef9294b460014382a2a594c77f8900d4"
I20260502 20:00:43.137930 10744 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:43.139120 10744 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b470a66ad54f46b1b44a80dd1edf214e in term 1.
I20260502 20:00:43.139645 10771 sys_catalog.cc:565] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260502 20:00:43.145062 10889 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:43.147240 10889 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:43.157619 10744 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 1 FOLLOWER]: Refusing update from remote peer b470a66ad54f46b1b44a80dd1edf214e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 20:00:43.158390 10885 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:43.163565 10889 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b470a66ad54f46b1b44a80dd1edf214e. Latest consensus state: current_term: 1 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:43.163810 10889 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:43.164819 10674 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 1 FOLLOWER]: Refusing update from remote peer b470a66ad54f46b1b44a80dd1edf214e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 20:00:43.165442 10885 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [LEADER]: Connected to new peer: Peer: permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:43.169129 10850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader b470a66ad54f46b1b44a80dd1edf214e. Latest consensus state: current_term: 1 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:43.169270 10850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: FOLLOWER
W20260502 20:00:43.170497 10653 tablet.cc:2404] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260502 20:00:43.170655 10904 catalog_manager.cc:1568] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260502 20:00:43.170729 10904 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260502 20:00:43.180481 10885 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:43.180624 10885 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:43.181303 10868 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:43.181401 10868 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:43.182619 10850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:43.182729 10850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:43.184340 10889 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:43.184521 10889 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:43.184669 10890 mvcc.cc:204] Tried to move back new op lower bound from 7281672368738213888 to 7281672368557486080. Current Snapshot: MvccSnapshot[applied={T|T < 7281672368738213888}]
I20260502 20:00:43.185637 10907 mvcc.cc:204] Tried to move back new op lower bound from 7281672368738213888 to 7281672368557486080. Current Snapshot: MvccSnapshot[applied={T|T < 7281672368738213888}]
I20260502 20:00:43.200249 10887 catalog_manager.cc:1357] Generated new cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:00:43.200337 10887 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 20:00:43.235078 10887 catalog_manager.cc:1380] Generated new certificate authority record
I20260502 20:00:43.242204 10887 catalog_manager.cc:1514] Loading token signing keys...
I20260502 20:00:43.263576 10887 catalog_manager.cc:6044] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Generated new TSK 0
I20260502 20:00:43.264391 10887 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 20:00:43.265105 10887 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 20:00:43.274114 10887 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: -1
I20260502 20:00:43.296319 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.27.129:0
--local_ip_for_outbound_sockets=127.10.27.129
--webserver_interface=127.10.27.129
--webserver_port=0
--tserver_master_addrs=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260502 20:00:43.474840 10915 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:00:43.475121 10915 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:00:43.475209 10915 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:00:43.478587 10915 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:00:43.478714 10915 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.27.129
I20260502 20:00:43.482839 10915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.27.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.27.129
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--never_fsync=true
--heap_profile_path=/tmp/kudu.10915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.27.129
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:00:43.483939 10915 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:00:43.485102 10915 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:00:43.492237 10923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:43.492339 10920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:43.492494 10921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:00:43.492771 10915 server_base.cc:1061] running on GCE node
I20260502 20:00:43.493257 10915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:00:43.493965 10915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:00:43.495147 10915 hybrid_clock.cc:648] HybridClock initialized: now 1777752043495119 us; error 47 us; skew 500 ppm
I20260502 20:00:43.497352 10915 webserver.cc:492] Webserver started at http://127.10.27.129:41693/ using document root <none> and password file <none>
I20260502 20:00:43.498020 10915 fs_manager.cc:362] Metadata directory not provided
I20260502 20:00:43.498096 10915 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:00:43.498296 10915 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260502 20:00:43.500356 10915 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/data/instance:
uuid: "858db0bc9f07476e9d1540f2b095414f"
format_stamp: "Formatted at 2026-05-02 20:00:43 on dist-test-slave-0dwf"
I20260502 20:00:43.500931 10915 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/instance:
uuid: "858db0bc9f07476e9d1540f2b095414f"
format_stamp: "Formatted at 2026-05-02 20:00:43 on dist-test-slave-0dwf"
I20260502 20:00:43.505314 10915 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260502 20:00:43.508140 10929 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:43.509481 10915 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260502 20:00:43.509629 10915 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal
uuid: "858db0bc9f07476e9d1540f2b095414f"
format_stamp: "Formatted at 2026-05-02 20:00:43 on dist-test-slave-0dwf"
I20260502 20:00:43.509748 10915 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:00:43.523298 10915 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:00:43.524000 10915 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:00:43.524178 10915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:00:43.524801 10915 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260502 20:00:43.526070 10915 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260502 20:00:43.526134 10915 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:43.526204 10915 ts_tablet_manager.cc:616] Registered 0 tablets
I20260502 20:00:43.526234 10915 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:43.536690 10915 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.129:36793
I20260502 20:00:43.536744 11042 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.129:36793 every 8 connection(s)
I20260502 20:00:43.538414 10915 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/data/info.pb
I20260502 20:00:43.542752 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 10915
I20260502 20:00:43.542883 10350 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/instance
I20260502 20:00:43.546097 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.27.130:0
--local_ip_for_outbound_sockets=127.10.27.130
--webserver_interface=127.10.27.130
--webserver_port=0
--tserver_master_addrs=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260502 20:00:43.548280 11044 heartbeater.cc:344] Connected to a master server at 127.10.27.190:46101
I20260502 20:00:43.548318 11045 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:00:43.548564 11045 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:43.548564 11044 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:43.549106 11044 heartbeater.cc:507] Master 127.10.27.190:46101 requested a full tablet report, sending...
I20260502 20:00:43.549116 11045 heartbeater.cc:507] Master 127.10.27.189:46281 requested a full tablet report, sending...
I20260502 20:00:43.550607 10664 ts_manager.cc:194] Registered new tserver with Master: 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:43.551623 10735 ts_manager.cc:194] Registered new tserver with Master: 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:43.552325 11043 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:00:43.552428 11043 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:43.552660 11043 heartbeater.cc:507] Master 127.10.27.188:33369 requested a full tablet report, sending...
I20260502 20:00:43.553572 10806 ts_manager.cc:194] Registered new tserver with Master: 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:43.554839 10806 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.27.129:34997
W20260502 20:00:43.666429 11050 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:00:43.666707 11050 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:00:43.666787 11050 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:00:43.670356 11050 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:00:43.670482 11050 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.27.130
I20260502 20:00:43.674643 11050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.27.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.27.130
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--never_fsync=true
--heap_profile_path=/tmp/kudu.11050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.27.130
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:00:43.675737 11050 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:00:43.677120 11050 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:00:43.685070 11058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:43.685089 11056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:43.685163 11055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:00:43.686164 11050 server_base.cc:1061] running on GCE node
I20260502 20:00:43.686563 11050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:00:43.687206 11050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:00:43.688385 11050 hybrid_clock.cc:648] HybridClock initialized: now 1777752043688372 us; error 29 us; skew 500 ppm
I20260502 20:00:43.690156 11050 webserver.cc:492] Webserver started at http://127.10.27.130:37873/ using document root <none> and password file <none>
I20260502 20:00:43.690807 11050 fs_manager.cc:362] Metadata directory not provided
I20260502 20:00:43.690881 11050 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:00:43.691152 11050 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260502 20:00:43.692667 11050 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/data/instance:
uuid: "b85d150f168f406bb31ff44150b2b1a1"
format_stamp: "Formatted at 2026-05-02 20:00:43 on dist-test-slave-0dwf"
I20260502 20:00:43.693161 11050 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/instance:
uuid: "b85d150f168f406bb31ff44150b2b1a1"
format_stamp: "Formatted at 2026-05-02 20:00:43 on dist-test-slave-0dwf"
I20260502 20:00:43.696552 11050 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260502 20:00:43.698755 11064 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:43.699820 11050 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260502 20:00:43.699955 11050 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal
uuid: "b85d150f168f406bb31ff44150b2b1a1"
format_stamp: "Formatted at 2026-05-02 20:00:43 on dist-test-slave-0dwf"
I20260502 20:00:43.700098 11050 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:00:43.719448 11050 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:00:43.720136 11050 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:00:43.720355 11050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:00:43.720940 11050 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260502 20:00:43.721956 11050 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260502 20:00:43.722028 11050 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:43.722124 11050 ts_tablet_manager.cc:616] Registered 0 tablets
I20260502 20:00:43.722172 11050 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:43.731941 11050 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.130:43285
I20260502 20:00:43.731962 11177 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.130:43285 every 8 connection(s)
I20260502 20:00:43.732882 11050 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/data/info.pb
I20260502 20:00:43.734752 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 11050
I20260502 20:00:43.734849 10350 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/instance
I20260502 20:00:43.737954 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.27.131:0
--local_ip_for_outbound_sockets=127.10.27.131
--webserver_interface=127.10.27.131
--webserver_port=0
--tserver_master_addrs=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260502 20:00:43.743546 11178 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:00:43.743634 11180 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:00:43.743590 11179 heartbeater.cc:344] Connected to a master server at 127.10.27.190:46101
I20260502 20:00:43.743805 11180 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:43.743805 11178 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:43.743901 11179 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:43.744511 11178 heartbeater.cc:507] Master 127.10.27.188:33369 requested a full tablet report, sending...
I20260502 20:00:43.744529 11180 heartbeater.cc:507] Master 127.10.27.189:46281 requested a full tablet report, sending...
I20260502 20:00:43.744511 11179 heartbeater.cc:507] Master 127.10.27.190:46101 requested a full tablet report, sending...
I20260502 20:00:43.745592 10806 ts_manager.cc:194] Registered new tserver with Master: b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:43.745645 10664 ts_manager.cc:194] Registered new tserver with Master: b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:43.745711 10735 ts_manager.cc:194] Registered new tserver with Master: b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:43.746333 10806 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.27.130:60079
I20260502 20:00:43.762655 11186 raft_consensus.cc:493] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:00:43.762825 11186 raft_consensus.cc:515] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:43.763329 11187 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:00:43.763486 11187 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:43.764304 10744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38315e4f56484666b5e54afad02498ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9294b460014382a2a594c77f8900d4" is_pre_election: true
I20260502 20:00:43.764437 10744 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38315e4f56484666b5e54afad02498ec in term 1.
I20260502 20:00:43.764564 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ef9294b460014382a2a594c77f8900d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "38315e4f56484666b5e54afad02498ec" is_pre_election: true
I20260502 20:00:43.764573 10816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38315e4f56484666b5e54afad02498ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b470a66ad54f46b1b44a80dd1edf214e" is_pre_election: true
I20260502 20:00:43.764686 10674 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9294b460014382a2a594c77f8900d4 in term 1.
I20260502 20:00:43.764894 10648 leader_election.cc:304] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4; no voters:
I20260502 20:00:43.765028 10720 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4; no voters:
I20260502 20:00:43.765115 11186 leader_election.cc:290] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
I20260502 20:00:43.765218 11188 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260502 20:00:43.765266 11188 raft_consensus.cc:493] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:00:43.765303 11188 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 1 FOLLOWER]: Advancing to term 2
I20260502 20:00:43.765529 11187 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
I20260502 20:00:43.765654 11187 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260502 20:00:43.765710 11187 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:00:43.765761 11187 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 1 FOLLOWER]: Advancing to term 2
I20260502 20:00:43.765830 10816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ef9294b460014382a2a594c77f8900d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b470a66ad54f46b1b44a80dd1edf214e" is_pre_election: true
I20260502 20:00:43.807724 11187 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:43.808000 11188 raft_consensus.cc:515] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:43.808378 11187 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 2 election: Requested vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
I20260502 20:00:43.808879 10744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38315e4f56484666b5e54afad02498ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9294b460014382a2a594c77f8900d4"
I20260502 20:00:43.809084 10744 raft_consensus.cc:2393] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 38315e4f56484666b5e54afad02498ec in current term 2: Already voted for candidate ef9294b460014382a2a594c77f8900d4 in this term.
I20260502 20:00:43.809326 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ef9294b460014382a2a594c77f8900d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "38315e4f56484666b5e54afad02498ec"
I20260502 20:00:43.809360 10816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ef9294b460014382a2a594c77f8900d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b470a66ad54f46b1b44a80dd1edf214e"
I20260502 20:00:43.809520 10674 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef9294b460014382a2a594c77f8900d4 in current term 2: Already voted for candidate 38315e4f56484666b5e54afad02498ec in this term.
I20260502 20:00:43.810084 10721 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e
I20260502 20:00:43.810362 11187 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260502 20:00:43.810665 11188 leader_election.cc:290] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 2 election: Requested vote from peers ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
I20260502 20:00:43.810820 10816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38315e4f56484666b5e54afad02498ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b470a66ad54f46b1b44a80dd1edf214e"
I20260502 20:00:43.811399 10650 leader_election.cc:304] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38315e4f56484666b5e54afad02498ec; no voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4
I20260502 20:00:43.811635 11188 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260502 20:00:43.818267 10674 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 2 FOLLOWER]: Rejecting Update request from peer b470a66ad54f46b1b44a80dd1edf214e for earlier term 1. Current term is 2. Ops: []
I20260502 20:00:43.818822 11190 consensus_queue.cc:1059] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260502 20:00:43.819195 11190 raft_consensus.cc:3055] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 1 LEADER]: Stepping down as leader of term 1
I20260502 20:00:43.819247 11190 raft_consensus.cc:740] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b470a66ad54f46b1b44a80dd1edf214e, State: Running, Role: LEADER
I20260502 20:00:43.819443 11190 consensus_queue.cc:260] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:43.819752 11190 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 1 FOLLOWER]: Advancing to term 2
W20260502 20:00:43.852494 11185 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:00:43.852811 11185 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:00:43.852914 11185 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:00:43.857595 11185 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:00:43.857787 11185 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.27.131
I20260502 20:00:43.862056 11185 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.27.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.27.131
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--never_fsync=true
--heap_profile_path=/tmp/kudu.11185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.27.131
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:00:43.863446 11185 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:00:43.864676 11185 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:00:43.872594 11197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:43.872759 11196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:43.872752 11199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:00:43.873060 11185 server_base.cc:1061] running on GCE node
I20260502 20:00:43.873860 11185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:00:43.874805 11185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:00:43.876127 11185 hybrid_clock.cc:648] HybridClock initialized: now 1777752043876057 us; error 85 us; skew 500 ppm
I20260502 20:00:43.878579 11185 webserver.cc:492] Webserver started at http://127.10.27.131:32981/ using document root <none> and password file <none>
I20260502 20:00:43.879354 11185 fs_manager.cc:362] Metadata directory not provided
I20260502 20:00:43.879454 11185 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:00:43.879711 11185 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260502 20:00:43.881518 11185 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/data/instance:
uuid: "ade741c4062940adb2223b55187ffe72"
format_stamp: "Formatted at 2026-05-02 20:00:43 on dist-test-slave-0dwf"
I20260502 20:00:43.882090 11185 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/instance:
uuid: "ade741c4062940adb2223b55187ffe72"
format_stamp: "Formatted at 2026-05-02 20:00:43 on dist-test-slave-0dwf"
I20260502 20:00:43.886617 11185 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260502 20:00:43.889669 11205 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:43.891002 11185 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260502 20:00:43.891184 11185 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal
uuid: "ade741c4062940adb2223b55187ffe72"
format_stamp: "Formatted at 2026-05-02 20:00:43 on dist-test-slave-0dwf"
I20260502 20:00:43.891304 11185 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:00:43.924571 11185 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:00:43.925341 11185 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:00:43.925555 11185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:00:43.926280 11185 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260502 20:00:43.927604 11185 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260502 20:00:43.927675 11185 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:43.927748 11185 ts_tablet_manager.cc:616] Registered 0 tablets
I20260502 20:00:43.927788 11185 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:43.941435 11185 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.131:43389
I20260502 20:00:43.941634 11318 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.131:43389 every 8 connection(s)
I20260502 20:00:43.943234 11185 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/data/info.pb
I20260502 20:00:43.946171 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 11185
I20260502 20:00:43.946293 10350 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/instance
I20260502 20:00:43.956209 11320 heartbeater.cc:344] Connected to a master server at 127.10.27.190:46101
I20260502 20:00:43.956255 11321 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:00:43.956517 11320 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:43.956501 11321 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:43.956543 11319 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:00:43.956677 11319 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:43.957247 11319 heartbeater.cc:507] Master 127.10.27.188:33369 requested a full tablet report, sending...
I20260502 20:00:43.957254 11320 heartbeater.cc:507] Master 127.10.27.190:46101 requested a full tablet report, sending...
I20260502 20:00:43.957254 11321 heartbeater.cc:507] Master 127.10.27.189:46281 requested a full tablet report, sending...
I20260502 20:00:43.958489 10806 ts_manager.cc:194] Registered new tserver with Master: ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:43.958518 10735 ts_manager.cc:194] Registered new tserver with Master: ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:43.958621 10664 ts_manager.cc:194] Registered new tserver with Master: ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:43.969730 10350 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20260502 20:00:44.056710 11043 heartbeater.cc:499] Master 127.10.27.188:33369 was elected leader, sending a full tablet report...
I20260502 20:00:44.059631 10865 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:00:44.059720 10865 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: loading cluster ID for follower catalog manager: success
I20260502 20:00:44.062217 10865 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: acquiring CA information for follower catalog manager: success
I20260502 20:00:44.063827 10865 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 20:00:44.070901 10882 catalog_manager.cc:1612] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 20:00:44.172185 10904 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:00:44.172303 10904 catalog_manager.cc:1562] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: loading cluster ID for follower catalog manager: success
I20260502 20:00:44.174015 10904 catalog_manager.cc:1584] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: acquiring CA information for follower catalog manager: success
I20260502 20:00:44.175151 10904 catalog_manager.cc:1612] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 20:00:44.247987 11178 heartbeater.cc:499] Master 127.10.27.188:33369 was elected leader, sending a full tablet report...
I20260502 20:00:44.253401 11190 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:44.253538 11190 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:44.254033 11190 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
I20260502 20:00:44.254559 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b470a66ad54f46b1b44a80dd1edf214e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "38315e4f56484666b5e54afad02498ec" is_pre_election: true
I20260502 20:00:44.254559 10744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b470a66ad54f46b1b44a80dd1edf214e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9294b460014382a2a594c77f8900d4" is_pre_election: true
I20260502 20:00:44.254720 10744 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b470a66ad54f46b1b44a80dd1edf214e in term 2.
I20260502 20:00:44.254720 10674 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b470a66ad54f46b1b44a80dd1edf214e in term 2.
I20260502 20:00:44.255069 10790 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4; no voters:
I20260502 20:00:44.255280 11190 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260502 20:00:44.255369 11190 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:44.255409 11190 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 2 FOLLOWER]: Advancing to term 3
I20260502 20:00:44.305450 11190 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:44.306051 11190 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 3 election: Requested vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
I20260502 20:00:44.306567 10674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b470a66ad54f46b1b44a80dd1edf214e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "38315e4f56484666b5e54afad02498ec"
I20260502 20:00:44.306636 10744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b470a66ad54f46b1b44a80dd1edf214e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef9294b460014382a2a594c77f8900d4"
I20260502 20:00:44.306741 10674 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 2 FOLLOWER]: Advancing to term 3
I20260502 20:00:44.306797 10744 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 2 FOLLOWER]: Advancing to term 3
I20260502 20:00:44.307667 10674 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b470a66ad54f46b1b44a80dd1edf214e in term 3.
I20260502 20:00:44.308051 10791 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e; no voters:
I20260502 20:00:44.308125 10744 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b470a66ad54f46b1b44a80dd1edf214e in term 3.
I20260502 20:00:44.308236 11190 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 3 FOLLOWER]: Leader election won for term 3
I20260502 20:00:44.308334 11190 raft_consensus.cc:697] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 3 LEADER]: Becoming Leader. State: Replica: b470a66ad54f46b1b44a80dd1edf214e, State: Running, Role: LEADER
I20260502 20:00:44.308486 11190 consensus_queue.cc:237] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:44.309182 11191 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b470a66ad54f46b1b44a80dd1edf214e. Latest consensus state: current_term: 3 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:44.309284 11191 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:44.309525 11334 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 20:00:44.310235 11334 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 20:00:44.310668 11334 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:00:44.310714 11334 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 20:00:44.311429 11334 catalog_manager.cc:1514] Loading token signing keys...
I20260502 20:00:44.311811 11334 catalog_manager.cc:6055] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Loaded TSK: 0
I20260502 20:00:44.312278 11334 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 20:00:44.312584 11334 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 20:00:44.312839 11334 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: -1
I20260502 20:00:44.337940 10350 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu with pid 10633
I20260502 20:00:44.340484 10804 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_b451db44fa8e4d43a95881c29b8c60da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:44.340633 10798 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_a6206a3729bf45dd8fcbcd4401f97845"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:44.340693 10806 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_ca365f139e204571a925ae336a6fd2fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:44.341075 10801 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_11635cffa19740e19919a56d36ca0879"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:44.341136 10805 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_69320349621b4b9399e4602c5d03321a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:44.341388 10799 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_92210f99df6644f08ec2076ab59d9a8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:44.341425 10800 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_374d681ae8634e8a85619deb2997bb74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:44.341639 10802 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_80d254b59aeb4715a2c7c15eaa36d97d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:44.341675 10797 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_ebde49fe473f4e73a80a82acbd08c0c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:44.341931 10803 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_ae16bd7eeae84bcc9df91b677d29e577"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260502 20:00:44.381379 10805 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_69320349621b4b9399e4602c5d03321a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:44.381520 10799 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_92210f99df6644f08ec2076ab59d9a8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:44.382076 10802 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_80d254b59aeb4715a2c7c15eaa36d97d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:44.383241 10797 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ebde49fe473f4e73a80a82acbd08c0c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:44.384054 10800 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_374d681ae8634e8a85619deb2997bb74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:44.384793 10806 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ca365f139e204571a925ae336a6fd2fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:44.381379 10801 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_11635cffa19740e19919a56d36ca0879 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:44.386853 10798 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a6206a3729bf45dd8fcbcd4401f97845 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:44.387184 10804 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b451db44fa8e4d43a95881c29b8c60da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:44.387184 10803 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ae16bd7eeae84bcc9df91b677d29e577 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:44.460951 11320 heartbeater.cc:646] Failed to heartbeat to 127.10.27.190:46101 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:00:44.554527 11044 heartbeater.cc:646] Failed to heartbeat to 127.10.27.190:46101 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:00:44.749683 11179 heartbeater.cc:646] Failed to heartbeat to 127.10.27.190:46101 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:00:44.827354 10744 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 3 FOLLOWER]: Refusing update from remote peer b470a66ad54f46b1b44a80dd1edf214e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260502 20:00:44.827881 11371 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260502 20:00:44.829058 11372 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b470a66ad54f46b1b44a80dd1edf214e. Latest consensus state: current_term: 3 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:44.829200 11372 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:44.830561 11374 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:44.830696 11374 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:44.831130 11372 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:44.831271 11372 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
W20260502 20:00:44.831688 10791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:00:44.832538 10791 consensus_peers.cc:597] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e -> Peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Couldn't send request to peer 38315e4f56484666b5e54afad02498ec. Status: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260502 20:00:45.058733 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.190:46101
--webserver_interface=127.10.27.190
--webserver_port=38717
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 20:00:45.179409 11382 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:00:45.179679 11382 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:00:45.179755 11382 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:00:45.183552 11382 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 20:00:45.183635 11382 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:00:45.183656 11382 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 20:00:45.183674 11382 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 20:00:45.188170 11382 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.190:46101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.27.190
--webserver_port=38717
--never_fsync=true
--heap_profile_path=/tmp/kudu.11382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:00:45.189388 11382 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:00:45.190600 11382 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:00:45.196949 11388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:45.196954 11387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:00:45.197149 11382 server_base.cc:1061] running on GCE node
W20260502 20:00:45.197196 11390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:00:45.197817 11382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:00:45.198771 11382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:00:45.202157 11382 hybrid_clock.cc:648] HybridClock initialized: now 1777752045202160 us; error 89 us; skew 500 ppm
I20260502 20:00:45.204421 11382 webserver.cc:492] Webserver started at http://127.10.27.190:38717/ using document root <none> and password file <none>
I20260502 20:00:45.205369 11382 fs_manager.cc:362] Metadata directory not provided
I20260502 20:00:45.205467 11382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:00:45.210218 11382 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.000s sys 0.002s
I20260502 20:00:45.212810 11396 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:45.214094 11382 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260502 20:00:45.214260 11382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
uuid: "38315e4f56484666b5e54afad02498ec"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:00:45.214710 11382 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:00:45.235527 11382 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:00:45.236337 11382 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:00:45.236531 11382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:00:45.245066 11382 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.190:46101
I20260502 20:00:45.245261 11448 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.190:46101 every 8 connection(s)
I20260502 20:00:45.246239 11382 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data/info.pb
I20260502 20:00:45.250605 11449 sys_catalog.cc:263] Verifying existing consensus state
I20260502 20:00:45.252951 11449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Bootstrap starting.
I20260502 20:00:45.256234 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 11382
I20260502 20:00:45.258750 11179 heartbeater.cc:344] Connected to a master server at 127.10.27.190:46101
I20260502 20:00:45.259706 11449 log.cc:826] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Log is configured to *not* fsync() on all Append() calls
I20260502 20:00:45.267813 11449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:00:45.268211 11449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Bootstrap complete.
I20260502 20:00:45.271517 11449 raft_consensus.cc:359] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:45.272145 11449 raft_consensus.cc:740] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38315e4f56484666b5e54afad02498ec, State: Initialized, Role: FOLLOWER
I20260502 20:00:45.272641 11449 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:45.273152 11454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:45.273326 11454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:45.273921 11449 sys_catalog.cc:565] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: configured and running, proceeding with master startup.
I20260502 20:00:45.281432 11468 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:00:45.281510 11468 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: loading cluster ID for follower catalog manager: success
I20260502 20:00:45.283823 11468 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: acquiring CA information for follower catalog manager: success
I20260502 20:00:45.285293 11468 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 20:00:45.295053 11454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader b470a66ad54f46b1b44a80dd1edf214e. Latest consensus state: current_term: 3 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:45.295229 11454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:45.295365 11454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:45.295450 11454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:45.480685 11320 heartbeater.cc:344] Connected to a master server at 127.10.27.190:46101
I20260502 20:00:45.482147 11413 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ade741c4062940adb2223b55187ffe72" instance_seqno: 1777752043938024) as {username='slave'} at 127.10.27.131:42511; Asking this server to re-register.
I20260502 20:00:45.482717 11320 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:45.483959 11413 ts_manager.cc:194] Registered new tserver with Master: ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:45.561600 11044 heartbeater.cc:344] Connected to a master server at 127.10.27.190:46101
I20260502 20:00:45.562435 11413 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" instance_seqno: 1777752043533877) as {username='slave'} at 127.10.27.129:48349; Asking this server to re-register.
I20260502 20:00:45.562951 11044 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:45.563807 11413 ts_manager.cc:194] Registered new tserver with Master: 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:00:45.726423 10879 hms_client.cc:285] Time spent create HMS table: real 1.340s user 0.000s sys 0.000s
I20260502 20:00:45.727036 10797 catalog_manager.cc:2174] created HMS catalog entry for table [id=7b1dce0350184df085c1148baa6c931b]
I20260502 20:00:45.729424 11374 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:45.729557 11374 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:45.742352 10797 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 31) took 1401 ms. Trace:
I20260502 20:00:45.742467 10797 rpcz_store.cc:276] 0502 20:00:44.340528 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:44.341601 (+ 1073us) service_pool.cc:224] Handling call
0502 20:00:44.383356 (+ 41755us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:44.383699 (+ 343us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:45.726922 (+1343223us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:45.741594 (+ 14672us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:45.742041 (+ 447us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:45.742325 (+ 284us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:45.728194 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:45.728313 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:45.728320 (+ 7us) write_op.cc:435] Acquired schema lock
0502 20:00:45.728324 (+ 4us) tablet.cc:662] Decoding operations
0502 20:00:45.728416 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:45.728427 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:45.728430 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:45.728490 (+ 60us) tablet.cc:701] Row locks acquired
0502 20:00:45.728491 (+ 1us) write_op.cc:260] PREPARE: finished
0502 20:00:45.728525 (+ 34us) write_op.cc:270] Start()
0502 20:00:45.728554 (+ 29us) write_op.cc:276] Timestamp: P: 1777752045728489 usec, L: 0
0502 20:00:45.728556 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 20:00:45.728721 (+ 165us) log.cc:844] Serialized 432 byte log entry
0502 20:00:45.734860 (+ 6139us) op_driver.cc:464] REPLICATION: finished
0502 20:00:45.741012 (+ 6152us) write_op.cc:301] APPLY: starting
0502 20:00:45.741028 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:45.741074 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:45.741091 (+ 17us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:45.741173 (+ 82us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:45.741209 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:45.741215 (+ 6us) write_op.cc:312] APPLY: finished
0502 20:00:45.741279 (+ 64us) log.cc:844] Serialized 28 byte log entry
0502 20:00:45.741511 (+ 232us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:45.741526 (+ 15us) write_op.cc:454] Released schema lock
0502 20:00:45.741532 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":2687,"Hive Metastore.run_cpu_time_us":652,"Hive Metastore.run_wall_time_us":1340016,"child_traces":[["op",{"apply.queue_time_us":6079,"leader-initialization.queue_time_us":6691,"leader-initialization.run_cpu_time_us":11,"leader-initialization.run_wall_time_us":11,"num_ops":2,"prepare.queue_time_us":259,"prepare.run_cpu_time_us":659,"prepare.run_wall_time_us":1543,"raft.queue_time_us":256,"raft.run_cpu_time_us":724,"raft.run_wall_time_us":723,"replication_time_us":6274,"thread_start_us":852,"threads_started":4}]]}
W20260502 20:00:45.743721 10797 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.27.131:55923 (request call id 2) took 1283 ms (client timeout 1000 ms). Trace:
W20260502 20:00:45.743780 10797 rpcz_store.cc:269] 0502 20:00:44.460203 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:45.743592 (+1283389us) service_pool.cc:211] Skipping call since client already timed out
0502 20:00:45.743691 (+ 99us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260502 20:00:45.743942 10797 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.27.129:34997 (request call id 3) took 1185 ms (client timeout 1000 ms). Trace:
W20260502 20:00:45.743985 10797 rpcz_store.cc:269] 0502 20:00:44.558956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:45.743909 (+1184953us) service_pool.cc:211] Skipping call since client already timed out
0502 20:00:45.743935 (+ 26us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260502 20:00:45.745219 10797 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.27.130:60079 (request call id 3) took 995 ms (client timeout 1000 ms). Trace:
W20260502 20:00:45.745280 10797 rpcz_store.cc:269] 0502 20:00:44.749940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:45.744061 (+994121us) service_pool.cc:224] Handling call
0502 20:00:45.745203 (+ 1142us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":0}
I20260502 20:00:45.751889 10797 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_ebde49fe473f4e73a80a82acbd08c0c9" } new_table_name: "default.Table_0d8473dff6e244c199473f589d46be1b" modify_external_catalogs: true
I20260502 20:00:45.761118 11413 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" instance_seqno: 1777752043728997) as {username='slave'} at 127.10.27.130:56337; Asking this server to re-register.
I20260502 20:00:45.761680 11179 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:45.762475 11413 ts_manager.cc:194] Registered new tserver with Master: b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:45.762455 11112 tablet_service.cc:1511] Processing CreateTablet for tablet 985daaf9d5364146a04caf0a5348d22a (DEFAULT_TABLE table=default.table_ebde49fe473f4e73a80a82acbd08c0c9 [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:45.763603 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985daaf9d5364146a04caf0a5348d22a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:45.768097 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 985daaf9d5364146a04caf0a5348d22a (DEFAULT_TABLE table=default.table_ebde49fe473f4e73a80a82acbd08c0c9 [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:45.768112 11253 tablet_service.cc:1511] Processing CreateTablet for tablet 985daaf9d5364146a04caf0a5348d22a (DEFAULT_TABLE table=default.table_ebde49fe473f4e73a80a82acbd08c0c9 [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:45.769029 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985daaf9d5364146a04caf0a5348d22a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:45.769033 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985daaf9d5364146a04caf0a5348d22a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:45.776705 11497 tablet_bootstrap.cc:492] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:45.777112 11499 tablet_bootstrap.cc:492] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:45.780164 11497 tablet_bootstrap.cc:654] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:45.782152 11499 tablet_bootstrap.cc:654] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:45.783195 11499 log.cc:826] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1: Log is configured to *not* fsync() on all Append() calls
I20260502 20:00:45.784148 11497 log.cc:826] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f: Log is configured to *not* fsync() on all Append() calls
I20260502 20:00:45.784693 11498 tablet_bootstrap.cc:492] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:45.787168 11498 tablet_bootstrap.cc:654] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:45.788923 11498 log.cc:826] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72: Log is configured to *not* fsync() on all Append() calls
I20260502 20:00:45.791743 11499 tablet_bootstrap.cc:492] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:45.792063 11499 ts_tablet_manager.cc:1403] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.003s
I20260502 20:00:45.795522 11499 raft_consensus.cc:359] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.796540 11499 raft_consensus.cc:385] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:45.796636 11499 raft_consensus.cc:740] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:45.797154 11499 consensus_queue.cc:260] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.797787 11497 tablet_bootstrap.cc:492] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:45.798043 11497 ts_tablet_manager.cc:1403] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.000s
I20260502 20:00:45.798353 11499 ts_tablet_manager.cc:1434] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260502 20:00:45.798695 11178 heartbeater.cc:499] Master 127.10.27.188:33369 was elected leader, sending a full tablet report...
I20260502 20:00:45.805088 11498 tablet_bootstrap.cc:492] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:45.805363 11498 ts_tablet_manager.cc:1403] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20260502 20:00:45.808261 11498 raft_consensus.cc:359] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.808494 11498 raft_consensus.cc:385] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:45.808532 11498 raft_consensus.cc:740] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:45.809298 11498 consensus_queue.cc:260] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.810391 11498 ts_tablet_manager.cc:1434] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260502 20:00:45.810436 11497 raft_consensus.cc:359] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.810662 11497 raft_consensus.cc:385] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:45.810739 11497 raft_consensus.cc:740] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:45.811259 11497 consensus_queue.cc:260] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.812336 11497 ts_tablet_manager.cc:1434] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.014s user 0.001s sys 0.004s
I20260502 20:00:45.819024 10800 catalog_manager.cc:2174] created HMS catalog entry for table [id=7f99eb7719134a54a8f42be5b8c48760]
I20260502 20:00:45.825764 10800 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 28) took 1485 ms. Trace:
I20260502 20:00:45.825888 10800 rpcz_store.cc:276] 0502 20:00:44.340333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:44.341346 (+ 1013us) service_pool.cc:224] Handling call
0502 20:00:44.384158 (+ 42812us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:44.384479 (+ 321us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:45.819012 (+1434533us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:45.825532 (+ 6520us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:45.825622 (+ 90us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:45.825742 (+ 120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:45.819764 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:45.819879 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:45.819884 (+ 5us) write_op.cc:435] Acquired schema lock
0502 20:00:45.819885 (+ 1us) tablet.cc:662] Decoding operations
0502 20:00:45.819958 (+ 73us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:45.819969 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:45.819972 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:45.820153 (+ 181us) tablet.cc:701] Row locks acquired
0502 20:00:45.820156 (+ 3us) write_op.cc:260] PREPARE: finished
0502 20:00:45.820202 (+ 46us) write_op.cc:270] Start()
0502 20:00:45.820239 (+ 37us) write_op.cc:276] Timestamp: P: 1777752045820159 usec, L: 0
0502 20:00:45.820240 (+ 1us) op_driver.cc:348] REPLICATION: starting
0502 20:00:45.820493 (+ 253us) log.cc:844] Serialized 432 byte log entry
0502 20:00:45.824232 (+ 3739us) op_driver.cc:464] REPLICATION: finished
0502 20:00:45.824352 (+ 120us) write_op.cc:301] APPLY: starting
0502 20:00:45.824371 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:45.824409 (+ 38us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:45.824427 (+ 18us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:45.824503 (+ 76us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:45.824532 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:45.824538 (+ 6us) write_op.cc:312] APPLY: finished
0502 20:00:45.824596 (+ 58us) log.cc:844] Serialized 28 byte log entry
0502 20:00:45.824643 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:45.824657 (+ 14us) write_op.cc:454] Released schema lock
0502 20:00:45.824661 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0502 20:00:45.824722 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:45.824726 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1342068,"Hive Metastore.run_cpu_time_us":224,"Hive Metastore.run_wall_time_us":91961,"child_traces":[["op",{"apply.queue_time_us":50,"apply.run_cpu_time_us":387,"apply.run_wall_time_us":387,"num_ops":2,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":836,"prepare.run_wall_time_us":838,"raft.queue_time_us":1266,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":420,"replication_time_us":3964}]]}
I20260502 20:00:45.838537 11112 tablet_service.cc:1511] Processing CreateTablet for tablet 60b6d72589a9465692d851093aef3cb8 (DEFAULT_TABLE table=default.table_374d681ae8634e8a85619deb2997bb74 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:45.839488 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b6d72589a9465692d851093aef3cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:45.843575 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 60b6d72589a9465692d851093aef3cb8 (DEFAULT_TABLE table=default.table_374d681ae8634e8a85619deb2997bb74 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:45.843904 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b6d72589a9465692d851093aef3cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:45.846335 11253 tablet_service.cc:1511] Processing CreateTablet for tablet 60b6d72589a9465692d851093aef3cb8 (DEFAULT_TABLE table=default.table_374d681ae8634e8a85619deb2997bb74 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:45.846644 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b6d72589a9465692d851093aef3cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:45.846735 11497 tablet_bootstrap.cc:492] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:45.847954 11497 tablet_bootstrap.cc:654] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:45.849083 11498 tablet_bootstrap.cc:492] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:45.850239 11498 tablet_bootstrap.cc:654] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:45.852540 11499 tablet_bootstrap.cc:492] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:45.853765 11499 tablet_bootstrap.cc:654] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:45.853900 11497 tablet_bootstrap.cc:492] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:45.853991 11497 ts_tablet_manager.cc:1403] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260502 20:00:45.854575 11497 raft_consensus.cc:359] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.854701 11497 raft_consensus.cc:385] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:45.854730 11497 raft_consensus.cc:740] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:45.855394 11497 consensus_queue.cc:260] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.856197 10800 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.27.131:55923
I20260502 20:00:45.859239 10800 master_service.cc:954] ReplaceTablet: received request to replace tablet 985daaf9d5364146a04caf0a5348d22a from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:45.859344 11043 heartbeater.cc:499] Master 127.10.27.188:33369 was elected leader, sending a full tablet report...
I20260502 20:00:45.860538 11319 heartbeater.cc:499] Master 127.10.27.188:33369 was elected leader, sending a full tablet report...
I20260502 20:00:45.862207 11498 tablet_bootstrap.cc:492] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:45.862308 11498 ts_tablet_manager.cc:1403] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260502 20:00:45.862973 11498 raft_consensus.cc:359] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.863231 11498 raft_consensus.cc:385] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:45.863284 11498 raft_consensus.cc:740] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:45.863421 11498 consensus_queue.cc:260] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.863734 11498 ts_tablet_manager.cc:1434] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:45.867911 11505 raft_consensus.cc:493] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:45.868114 11505 raft_consensus.cc:515] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.868535 10800 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet 985daaf9d5364146a04caf0a5348d22a
I20260502 20:00:45.869254 10976 tablet_service.cc:1558] Processing DeleteTablet for tablet 985daaf9d5364146a04caf0a5348d22a with delete_type TABLET_DATA_DELETED (replaced by tablet f9c736521db340f8a196571bae1d1beb) from {username='slave'} at 127.0.0.1:38494
I20260502 20:00:45.869453 11505 leader_election.cc:290] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:45.870293 11112 tablet_service.cc:1558] Processing DeleteTablet for tablet 985daaf9d5364146a04caf0a5348d22a with delete_type TABLET_DATA_DELETED (replaced by tablet f9c736521db340f8a196571bae1d1beb) from {username='slave'} at 127.0.0.1:36722
I20260502 20:00:45.868122 11497 ts_tablet_manager.cc:1434] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260502 20:00:45.871879 11503 raft_consensus.cc:493] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:45.872026 11503 raft_consensus.cc:515] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.873310 11503 leader_election.cc:290] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:45.877537 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985daaf9d5364146a04caf0a5348d22a" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:45.877856 11273 raft_consensus.cc:2468] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:45.878326 10930 leader_election.cc:304] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:45.878612 11505 raft_consensus.cc:2804] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:45.878676 11505 raft_consensus.cc:493] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:45.878718 11505 raft_consensus.cc:3060] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:45.880858 11253 tablet_service.cc:1558] Processing DeleteTablet for tablet 985daaf9d5364146a04caf0a5348d22a with delete_type TABLET_DATA_DELETED (replaced by tablet f9c736521db340f8a196571bae1d1beb) from {username='slave'} at 127.0.0.1:54214
I20260502 20:00:45.884904 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985daaf9d5364146a04caf0a5348d22a" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:45.885150 11132 raft_consensus.cc:2468] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:45.885900 11515 tablet_replica.cc:333] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:45.886224 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985daaf9d5364146a04caf0a5348d22a" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:45.886261 11515 raft_consensus.cc:2243] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:45.886543 11515 raft_consensus.cc:2272] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:45.888109 11515 ts_tablet_manager.cc:1916] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:45.891302 10976 tablet_service.cc:1511] Processing CreateTablet for tablet f9c736521db340f8a196571bae1d1beb (DEFAULT_TABLE table=default.table_ebde49fe473f4e73a80a82acbd08c0c9 [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:45.891650 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9c736521db340f8a196571bae1d1beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:45.892594 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985daaf9d5364146a04caf0a5348d22a" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
W20260502 20:00:45.893338 11065 leader_election.cc:343] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Illegal state: Tablet not RUNNING: STOPPED
I20260502 20:00:45.894177 11112 tablet_service.cc:1511] Processing CreateTablet for tablet f9c736521db340f8a196571bae1d1beb (DEFAULT_TABLE table=default.table_ebde49fe473f4e73a80a82acbd08c0c9 [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:45.894487 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9c736521db340f8a196571bae1d1beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:45.894997 11509 tablet_replica.cc:333] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:45.895301 11253 tablet_service.cc:1511] Processing CreateTablet for tablet f9c736521db340f8a196571bae1d1beb (DEFAULT_TABLE table=default.table_ebde49fe473f4e73a80a82acbd08c0c9 [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:45.895632 11499 tablet_bootstrap.cc:492] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:45.895740 11499 ts_tablet_manager.cc:1403] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.001s
I20260502 20:00:45.896485 11499 raft_consensus.cc:359] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.896638 11499 raft_consensus.cc:385] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:45.896678 11499 raft_consensus.cc:740] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:45.896827 11499 consensus_queue.cc:260] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.897111 11499 ts_tablet_manager.cc:1434] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260502 20:00:45.897351 11499 tablet_bootstrap.cc:492] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:45.898161 10800 catalog_manager.cc:6741] ReplaceTablet: tablet 985daaf9d5364146a04caf0a5348d22a deleted and replaced by tablet f9c736521db340f8a196571bae1d1beb
I20260502 20:00:45.898571 11499 tablet_bootstrap.cc:654] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:45.900743 11510 tablet_replica.cc:333] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:45.901190 11510 raft_consensus.cc:2243] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:45.901489 11510 raft_consensus.cc:2272] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:45.902205 10800 master_service.cc:954] ReplaceTablet: received request to replace tablet 985daaf9d5364146a04caf0a5348d22a from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:45.902531 10800 master_service.cc:954] ReplaceTablet: received request to replace tablet 985daaf9d5364146a04caf0a5348d22a from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:45.903097 11510 ts_tablet_manager.cc:1916] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:45.904577 10800 master_service.cc:954] ReplaceTablet: received request to replace tablet 985daaf9d5364146a04caf0a5348d22a from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:45.904865 10800 master_service.cc:954] ReplaceTablet: received request to replace tablet 985daaf9d5364146a04caf0a5348d22a from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:45.905196 10800 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_374d681ae8634e8a85619deb2997bb74" } new_table_name: "default.Table_115178421c134252971c7a71b1134464" modify_external_catalogs: true
I20260502 20:00:45.905787 11499 tablet_bootstrap.cc:492] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:45.905903 11499 ts_tablet_manager.cc:1403] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260502 20:00:45.906463 11499 raft_consensus.cc:359] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.906585 11499 raft_consensus.cc:385] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:45.906616 11499 raft_consensus.cc:740] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:45.906744 11499 consensus_queue.cc:260] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.907065 11499 ts_tablet_manager.cc:1434] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260502 20:00:45.911862 11505 raft_consensus.cc:515] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.912196 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9c736521db340f8a196571bae1d1beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:45.912485 11505 leader_election.cc:290] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:45.912761 10982 raft_consensus.cc:2393] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b85d150f168f406bb31ff44150b2b1a1 in current term 1: Already voted for candidate 858db0bc9f07476e9d1540f2b095414f in this term.
I20260502 20:00:45.913653 11509 raft_consensus.cc:2243] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:45.914171 11509 raft_consensus.cc:2272] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:45.914547 11498 tablet_bootstrap.cc:492] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:45.916039 11498 tablet_bootstrap.cc:654] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:45.916100 11515 ts_tablet_manager.cc:1929] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260502 20:00:45.916198 11515 log.cc:1199] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/985daaf9d5364146a04caf0a5348d22a
I20260502 20:00:45.916469 11515 ts_tablet_manager.cc:1950] T 985daaf9d5364146a04caf0a5348d22a P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:45.917804 11509 ts_tablet_manager.cc:1916] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:45.919100 11497 tablet_bootstrap.cc:492] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:45.920157 11497 tablet_bootstrap.cc:654] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:45.921497 10806 catalog_manager.cc:2174] created HMS catalog entry for table [id=4ce433e96065488abd346ff7bb660464]
I20260502 20:00:45.921913 11065 leader_election.cc:304] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b85d150f168f406bb31ff44150b2b1a1; no voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72
I20260502 20:00:45.922127 11497 tablet_bootstrap.cc:492] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
W20260502 20:00:45.922150 11065 raft_consensus.cc:2686] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260502 20:00:45.922215 11497 ts_tablet_manager.cc:1403] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:45.922689 11497 raft_consensus.cc:359] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.922814 11497 raft_consensus.cc:385] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:45.922855 11497 raft_consensus.cc:740] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:45.923009 11497 consensus_queue.cc:260] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.923267 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985daaf9d5364146a04caf0a5348d22a" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:45.923390 11497 ts_tablet_manager.cc:1434] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:00:45.925104 11498 tablet_bootstrap.cc:492] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:45.925200 11498 ts_tablet_manager.cc:1403] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
W20260502 20:00:45.925463 10933 leader_election.cc:343] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Illegal state: Tablet not RUNNING: STOPPED
I20260502 20:00:45.925737 11498 raft_consensus.cc:359] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.925845 11498 raft_consensus.cc:385] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:45.925879 11498 raft_consensus.cc:740] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:45.926002 11498 consensus_queue.cc:260] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.926298 11498 ts_tablet_manager.cc:1434] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:45.930881 10806 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 22) took 1591 ms. Trace:
I20260502 20:00:45.930998 10806 rpcz_store.cc:276] 0502 20:00:44.339894 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:44.340576 (+ 682us) service_pool.cc:224] Handling call
0502 20:00:44.384869 (+ 44293us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:44.385189 (+ 320us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:45.921488 (+1536299us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:45.930684 (+ 9196us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:45.930785 (+ 101us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:45.930862 (+ 77us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:45.922499 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:45.922605 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:45.922622 (+ 17us) write_op.cc:435] Acquired schema lock
0502 20:00:45.922624 (+ 2us) tablet.cc:662] Decoding operations
0502 20:00:45.922705 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:45.922717 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:45.922721 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:45.922817 (+ 96us) tablet.cc:701] Row locks acquired
0502 20:00:45.922820 (+ 3us) write_op.cc:260] PREPARE: finished
0502 20:00:45.922858 (+ 38us) write_op.cc:270] Start()
0502 20:00:45.922891 (+ 33us) write_op.cc:276] Timestamp: P: 1777752045922808 usec, L: 0
0502 20:00:45.922894 (+ 3us) op_driver.cc:348] REPLICATION: starting
0502 20:00:45.926384 (+ 3490us) log.cc:844] Serialized 432 byte log entry
0502 20:00:45.930136 (+ 3752us) op_driver.cc:464] REPLICATION: finished
0502 20:00:45.930219 (+ 83us) write_op.cc:301] APPLY: starting
0502 20:00:45.930240 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:45.930275 (+ 35us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:45.930294 (+ 19us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:45.930378 (+ 84us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:45.930409 (+ 31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:45.930414 (+ 5us) write_op.cc:312] APPLY: finished
0502 20:00:45.930481 (+ 67us) log.cc:844] Serialized 28 byte log entry
0502 20:00:45.930532 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:45.930547 (+ 15us) write_op.cc:454] Released schema lock
0502 20:00:45.930552 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0502 20:00:45.930613 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:45.930615 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1433533,"Hive Metastore.run_cpu_time_us":279,"Hive Metastore.run_wall_time_us":102599,"child_traces":[["op",{"apply.queue_time_us":33,"apply.run_cpu_time_us":386,"apply.run_wall_time_us":387,"num_ops":2,"prepare.queue_time_us":530,"prepare.run_cpu_time_us":734,"prepare.run_wall_time_us":3994,"raft.queue_time_us":1095,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":395,"replication_time_us":7212}]]}
I20260502 20:00:45.944686 11253 tablet_service.cc:1511] Processing CreateTablet for tablet 82ccb69e9f7b48178ca59455bb46bb65 (DEFAULT_TABLE table=default.table_ca365f139e204571a925ae336a6fd2fd [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:45.945041 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ccb69e9f7b48178ca59455bb46bb65. 1 dirs total, 0 dirs full, 0 dirs failed
W20260502 20:00:45.946842 11322 tablet.cc:2404] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260502 20:00:45.947278 11498 tablet_bootstrap.cc:492] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:45.947574 11112 tablet_service.cc:1511] Processing CreateTablet for tablet 82ccb69e9f7b48178ca59455bb46bb65 (DEFAULT_TABLE table=default.table_ca365f139e204571a925ae336a6fd2fd [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:45.948340 11498 tablet_bootstrap.cc:654] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:45.949033 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 82ccb69e9f7b48178ca59455bb46bb65 (DEFAULT_TABLE table=default.table_ca365f139e204571a925ae336a6fd2fd [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:45.949551 10806 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_ca365f139e204571a925ae336a6fd2fd" } new_table_name: "default.Table_d4efc4ecb8b04c828595edb245352971" modify_external_catalogs: true
I20260502 20:00:45.951597 11498 tablet_bootstrap.cc:492] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:45.951704 11498 ts_tablet_manager.cc:1403] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 20:00:45.952207 11498 raft_consensus.cc:359] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.952332 11498 raft_consensus.cc:385] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:45.952373 11498 raft_consensus.cc:740] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:45.952508 11498 consensus_queue.cc:260] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.952791 11498 ts_tablet_manager.cc:1434] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:45.959810 11504 raft_consensus.cc:493] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:45.960078 11504 raft_consensus.cc:515] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.961310 11504 leader_election.cc:290] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:45.965723 11505 raft_consensus.cc:493] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:45.965883 11505 raft_consensus.cc:515] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:45.966439 11505 leader_election.cc:290] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:45.966959 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6d72589a9465692d851093aef3cb8" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:45.967195 11272 raft_consensus.cc:2468] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:45.967309 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c736521db340f8a196571bae1d1beb" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:45.967492 11132 raft_consensus.cc:2468] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:45.967533 10930 leader_election.cc:304] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:45.967765 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6d72589a9465692d851093aef3cb8" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:45.967888 11131 raft_consensus.cc:2468] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:45.968235 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c736521db340f8a196571bae1d1beb" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:45.968421 10982 raft_consensus.cc:2468] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:45.968715 11505 raft_consensus.cc:2804] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:45.968791 11505 raft_consensus.cc:493] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:45.968833 11505 raft_consensus.cc:3060] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:45.968781 11209 leader_election.cc:304] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:45.969192 11504 raft_consensus.cc:2804] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:45.969285 11504 raft_consensus.cc:493] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:45.969328 11504 raft_consensus.cc:3060] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:45.978176 11521 raft_consensus.cc:493] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:45.979086 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985daaf9d5364146a04caf0a5348d22a" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:45.979115 10790 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet 985daaf9d5364146a04caf0a5348d22a (table default.table_ebde49fe473f4e73a80a82acbd08c0c9 [id=7b1dce0350184df085c1148baa6c931b]) successfully deleted
I20260502 20:00:45.978338 11521 raft_consensus.cc:515] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
W20260502 20:00:45.979629 10930 leader_election.cc:343] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Illegal state: Tablet not RUNNING: SHUTDOWN
I20260502 20:00:45.979753 10930 leader_election.cc:304] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f; no voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1
W20260502 20:00:45.979862 10930 raft_consensus.cc:2686] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260502 20:00:45.980993 11521 leader_election.cc:290] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:00:45.981423 11209 leader_election.cc:343] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 82ccb69e9f7b48178ca59455bb46bb65
W20260502 20:00:45.981600 11206 leader_election.cc:343] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 82ccb69e9f7b48178ca59455bb46bb65
I20260502 20:00:45.981689 11206 leader_election.cc:304] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:00:45.982014 11521 raft_consensus.cc:2749] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260502 20:00:45.986073 11181 tablet.cc:2404] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260502 20:00:46.012665 11510 ts_tablet_manager.cc:1929] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260502 20:00:46.012802 11510 log.cc:1199] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/985daaf9d5364146a04caf0a5348d22a
I20260502 20:00:46.012970 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ccb69e9f7b48178ca59455bb46bb65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.013124 11510 ts_tablet_manager.cc:1950] T 985daaf9d5364146a04caf0a5348d22a P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:46.013384 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ccb69e9f7b48178ca59455bb46bb65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.016263 11504 raft_consensus.cc:515] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.016366 11499 tablet_bootstrap.cc:492] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:46.016820 11504 leader_election.cc:290] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:46.016822 11505 raft_consensus.cc:515] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.017244 11505 leader_election.cc:290] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:46.017585 11499 tablet_bootstrap.cc:654] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.017978 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c736521db340f8a196571bae1d1beb" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:46.018093 10982 raft_consensus.cc:3060] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.019063 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9c736521db340f8a196571bae1d1beb" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:46.019176 11132 raft_consensus.cc:3060] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.020239 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6d72589a9465692d851093aef3cb8" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:46.020236 10793 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet 985daaf9d5364146a04caf0a5348d22a (table default.table_ebde49fe473f4e73a80a82acbd08c0c9 [id=7b1dce0350184df085c1148baa6c931b]) successfully deleted
I20260502 20:00:46.020336 11131 raft_consensus.cc:3060] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.020814 11509 ts_tablet_manager.cc:1929] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260502 20:00:46.020893 11509 log.cc:1199] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/985daaf9d5364146a04caf0a5348d22a
I20260502 20:00:46.020910 11499 tablet_bootstrap.cc:492] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:46.020984 11499 ts_tablet_manager.cc:1403] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260502 20:00:46.021159 11509 ts_tablet_manager.cc:1950] T 985daaf9d5364146a04caf0a5348d22a P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:46.021391 11497 tablet_bootstrap.cc:492] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:46.021423 11499 raft_consensus.cc:359] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.021509 11499 raft_consensus.cc:385] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.021534 11499 raft_consensus.cc:740] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.021646 11499 consensus_queue.cc:260] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.021880 11499 ts_tablet_manager.cc:1434] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:46.022297 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6d72589a9465692d851093aef3cb8" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:46.022420 11273 raft_consensus.cc:3060] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.022472 11497 tablet_bootstrap.cc:654] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.024304 11497 tablet_bootstrap.cc:492] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:46.024391 11497 ts_tablet_manager.cc:1403] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260502 20:00:46.024848 11497 raft_consensus.cc:359] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.024950 11497 raft_consensus.cc:385] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.024978 11497 raft_consensus.cc:740] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.025110 11497 consensus_queue.cc:260] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.025350 11497 ts_tablet_manager.cc:1434] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260502 20:00:46.041638 11046 tablet.cc:2404] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260502 20:00:46.108695 11273 raft_consensus.cc:2468] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:46.108695 10982 raft_consensus.cc:2468] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:46.109231 10930 leader_election.cc:304] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:46.109460 11505 raft_consensus.cc:2804] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:46.109705 11505 raft_consensus.cc:697] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:46.109959 11505 consensus_queue.cc:237] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.112629 11206 leader_election.cc:304] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:46.112875 11504 raft_consensus.cc:2804] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:46.112970 11504 raft_consensus.cc:697] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Becoming Leader. State: Replica: ade741c4062940adb2223b55187ffe72, State: Running, Role: LEADER
I20260502 20:00:46.113217 11504 consensus_queue.cc:237] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.114495 10790 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet 985daaf9d5364146a04caf0a5348d22a (table default.table_ebde49fe473f4e73a80a82acbd08c0c9 [id=7b1dce0350184df085c1148baa6c931b]) successfully deleted
I20260502 20:00:46.114972 11132 raft_consensus.cc:2468] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:46.117185 10799 catalog_manager.cc:2174] created HMS catalog entry for table [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f]
I20260502 20:00:46.126076 10799 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 29) took 1785 ms. Trace:
I20260502 20:00:46.126176 10799 rpcz_store.cc:276] 0502 20:00:44.340393 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:44.341304 (+ 911us) service_pool.cc:224] Handling call
0502 20:00:44.381603 (+ 40299us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:44.385601 (+ 3998us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:46.117176 (+1731575us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:46.125856 (+ 8680us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:46.125959 (+ 103us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:46.126044 (+ 85us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:46.117755 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:46.117873 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:46.117878 (+ 5us) write_op.cc:435] Acquired schema lock
0502 20:00:46.117880 (+ 2us) tablet.cc:662] Decoding operations
0502 20:00:46.117953 (+ 73us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:46.117964 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:46.117967 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:46.118032 (+ 65us) tablet.cc:701] Row locks acquired
0502 20:00:46.118034 (+ 2us) write_op.cc:260] PREPARE: finished
0502 20:00:46.118068 (+ 34us) write_op.cc:270] Start()
0502 20:00:46.118098 (+ 30us) write_op.cc:276] Timestamp: P: 1777752046118036 usec, L: 0
0502 20:00:46.118100 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 20:00:46.118243 (+ 143us) log.cc:844] Serialized 432 byte log entry
0502 20:00:46.125141 (+ 6898us) op_driver.cc:464] REPLICATION: finished
0502 20:00:46.125226 (+ 85us) write_op.cc:301] APPLY: starting
0502 20:00:46.125247 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:46.125282 (+ 35us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:46.125298 (+ 16us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:46.125376 (+ 78us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:46.125407 (+ 31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:46.125412 (+ 5us) write_op.cc:312] APPLY: finished
0502 20:00:46.125478 (+ 66us) log.cc:844] Serialized 28 byte log entry
0502 20:00:46.125533 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:46.125548 (+ 15us) write_op.cc:454] Released schema lock
0502 20:00:46.125554 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0502 20:00:46.125622 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:46.125624 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1535768,"Hive Metastore.run_cpu_time_us":221,"Hive Metastore.run_wall_time_us":195667,"child_traces":[["op",{"apply.queue_time_us":30,"apply.run_cpu_time_us":390,"apply.run_wall_time_us":389,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":596,"prepare.run_wall_time_us":596,"raft.queue_time_us":930,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":395,"replication_time_us":7008}]]}
I20260502 20:00:46.135753 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea263d32fd2405985d4514c2ff02a39 (DEFAULT_TABLE table=default.table_92210f99df6644f08ec2076ab59d9a8e [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.135506 10799 catalog_manager.cc:5671] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 reported cstate change: term changed from 0 to 1, leader changed from <none> to ade741c4062940adb2223b55187ffe72 (127.10.27.131). New cstate: current_term: 1 leader_uuid: "ade741c4062940adb2223b55187ffe72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260502 20:00:46.135996 11112 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea263d32fd2405985d4514c2ff02a39 (DEFAULT_TABLE table=default.table_92210f99df6644f08ec2076ab59d9a8e [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.136178 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea263d32fd2405985d4514c2ff02a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.136298 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea263d32fd2405985d4514c2ff02a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.138842 11497 tablet_bootstrap.cc:492] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:46.140189 11253 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea263d32fd2405985d4514c2ff02a39 (DEFAULT_TABLE table=default.table_92210f99df6644f08ec2076ab59d9a8e [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.140374 11497 tablet_bootstrap.cc:654] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.140516 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea263d32fd2405985d4514c2ff02a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.142277 11497 tablet_bootstrap.cc:492] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:46.142385 11497 ts_tablet_manager.cc:1403] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 20:00:46.142890 11498 tablet_bootstrap.cc:492] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:46.142900 11497 raft_consensus.cc:359] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.143167 11497 raft_consensus.cc:385] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.143227 11497 raft_consensus.cc:740] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.143383 11497 consensus_queue.cc:260] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.143729 11497 ts_tablet_manager.cc:1434] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260502 20:00:46.143983 11498 tablet_bootstrap.cc:654] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.147713 10799 catalog_manager.cc:5671] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to 858db0bc9f07476e9d1540f2b095414f (127.10.27.129). New cstate: current_term: 1 leader_uuid: "858db0bc9f07476e9d1540f2b095414f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:46.149364 11498 tablet_bootstrap.cc:492] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:46.149494 11498 ts_tablet_manager.cc:1403] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260502 20:00:46.150075 11498 raft_consensus.cc:359] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.150211 11498 raft_consensus.cc:385] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.150259 11498 raft_consensus.cc:740] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.150408 11498 consensus_queue.cc:260] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.150744 11498 ts_tablet_manager.cc:1434] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:46.156338 10799 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_41826ad67ed540e0a427cd0347407518"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:46.185518 11505 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:46.185679 11505 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.186277 11505 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
W20260502 20:00:46.187033 10933 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:00:46.187254 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea263d32fd2405985d4514c2ff02a39" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:46.187419 11273 raft_consensus.cc:2468] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:46.187948 10930 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters: b85d150f168f406bb31ff44150b2b1a1
I20260502 20:00:46.188172 11505 raft_consensus.cc:2804] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:46.188253 11505 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:46.188299 11505 raft_consensus.cc:3060] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.209281 11131 raft_consensus.cc:2468] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:46.209247 11505 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.209811 11505 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:46.210678 11499 tablet_bootstrap.cc:492] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:46.211268 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea263d32fd2405985d4514c2ff02a39" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:46.211436 11273 raft_consensus.cc:3060] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.211946 11499 tablet_bootstrap.cc:654] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.212687 11273 raft_consensus.cc:2468] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:46.213254 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea263d32fd2405985d4514c2ff02a39" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
W20260502 20:00:46.214133 10933 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260502 20:00:46.214313 10930 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters: b85d150f168f406bb31ff44150b2b1a1
I20260502 20:00:46.214519 11505 raft_consensus.cc:2804] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:46.214614 11505 raft_consensus.cc:697] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:46.214767 11505 consensus_queue.cc:237] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.214861 11499 tablet_bootstrap.cc:492] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:46.214982 11499 ts_tablet_manager.cc:1403] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260502 20:00:46.215751 11499 raft_consensus.cc:359] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.215880 11499 raft_consensus.cc:385] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.215920 11499 raft_consensus.cc:740] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.216037 11499 consensus_queue.cc:260] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.216356 11499 ts_tablet_manager.cc:1434] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:46.258797 11505 raft_consensus.cc:493] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:46.258981 11505 raft_consensus.cc:515] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.259476 11505 leader_election.cc:290] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:46.260012 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb69e9f7b48178ca59455bb46bb65" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:46.260036 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb69e9f7b48178ca59455bb46bb65" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:46.260176 11131 raft_consensus.cc:2468] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:46.260290 11273 raft_consensus.cc:2468] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:46.260560 10933 leader_election.cc:304] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:46.260811 11505 raft_consensus.cc:2804] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:46.260883 11505 raft_consensus.cc:493] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:46.260931 11505 raft_consensus.cc:3060] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.309280 11505 raft_consensus.cc:515] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.309926 11505 leader_election.cc:290] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:46.310451 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb69e9f7b48178ca59455bb46bb65" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:46.310478 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ccb69e9f7b48178ca59455bb46bb65" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:46.310601 11131 raft_consensus.cc:3060] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.310627 11273 raft_consensus.cc:3060] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.311793 11273 raft_consensus.cc:2468] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:46.311944 11131 raft_consensus.cc:2468] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:46.312294 10930 leader_election.cc:304] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:46.312626 11505 raft_consensus.cc:2804] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:46.312737 11505 raft_consensus.cc:697] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:46.312896 11505 consensus_queue.cc:237] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.315361 10802 catalog_manager.cc:2174] created HMS catalog entry for table [id=128b3728f94e46d1b4450c586944e3dc]
I20260502 20:00:46.319829 10802 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 26) took 1979 ms. Trace:
I20260502 20:00:46.319931 10802 rpcz_store.cc:276] 0502 20:00:44.340201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:44.341556 (+ 1355us) service_pool.cc:224] Handling call
0502 20:00:44.382176 (+ 40620us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:44.382712 (+ 536us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:46.315351 (+1932639us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:46.319626 (+ 4275us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:46.319721 (+ 95us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:46.319811 (+ 90us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:46.315957 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:46.316078 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:46.316082 (+ 4us) write_op.cc:435] Acquired schema lock
0502 20:00:46.316084 (+ 2us) tablet.cc:662] Decoding operations
0502 20:00:46.316158 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:46.316169 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:46.316172 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:46.316253 (+ 81us) tablet.cc:701] Row locks acquired
0502 20:00:46.316255 (+ 2us) write_op.cc:260] PREPARE: finished
0502 20:00:46.316295 (+ 40us) write_op.cc:270] Start()
0502 20:00:46.316324 (+ 29us) write_op.cc:276] Timestamp: P: 1777752046316248 usec, L: 0
0502 20:00:46.316326 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 20:00:46.316464 (+ 138us) log.cc:844] Serialized 432 byte log entry
0502 20:00:46.318798 (+ 2334us) op_driver.cc:464] REPLICATION: finished
0502 20:00:46.318874 (+ 76us) write_op.cc:301] APPLY: starting
0502 20:00:46.318892 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:46.318928 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:46.319093 (+ 165us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:46.319180 (+ 87us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:46.319212 (+ 32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:46.319218 (+ 6us) write_op.cc:312] APPLY: finished
0502 20:00:46.319286 (+ 68us) log.cc:844] Serialized 28 byte log entry
0502 20:00:46.319340 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:46.319358 (+ 18us) write_op.cc:454] Released schema lock
0502 20:00:46.319364 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0502 20:00:46.319425 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:46.319428 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1731033,"Hive Metastore.run_cpu_time_us":219,"Hive Metastore.run_wall_time_us":197978,"spinlock_wait_cycles":90880,"child_traces":[["op",{"apply.queue_time_us":24,"apply.run_cpu_time_us":545,"apply.run_wall_time_us":546,"num_ops":2,"prepare.queue_time_us":70,"prepare.run_cpu_time_us":619,"prepare.run_wall_time_us":619,"raft.queue_time_us":366,"raft.run_cpu_time_us":499,"raft.run_wall_time_us":500,"replication_time_us":2443,"spinlock_wait_cycles":89472}]]}
I20260502 20:00:46.325131 10976 tablet_service.cc:1511] Processing CreateTablet for tablet eb15659f8f6549d49f44639345471f6e (DEFAULT_TABLE table=default.table_80d254b59aeb4715a2c7c15eaa36d97d [id=128b3728f94e46d1b4450c586944e3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.325253 11112 tablet_service.cc:1511] Processing CreateTablet for tablet eb15659f8f6549d49f44639345471f6e (DEFAULT_TABLE table=default.table_80d254b59aeb4715a2c7c15eaa36d97d [id=128b3728f94e46d1b4450c586944e3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.325469 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb15659f8f6549d49f44639345471f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.325482 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb15659f8f6549d49f44639345471f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.326159 10802 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_54d68ed8aef94a978c1ad2a5e5312cab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:46.327891 11253 tablet_service.cc:1511] Processing CreateTablet for tablet eb15659f8f6549d49f44639345471f6e (DEFAULT_TABLE table=default.table_80d254b59aeb4715a2c7c15eaa36d97d [id=128b3728f94e46d1b4450c586944e3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.328231 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb15659f8f6549d49f44639345471f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.329299 11497 tablet_bootstrap.cc:492] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:46.330480 11497 tablet_bootstrap.cc:654] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.330693 11498 tablet_bootstrap.cc:492] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:46.331753 11497 tablet_bootstrap.cc:492] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:46.331857 11498 tablet_bootstrap.cc:654] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.331852 11497 ts_tablet_manager.cc:1403] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:46.332408 11497 raft_consensus.cc:359] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.332537 11497 raft_consensus.cc:385] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.332569 11497 raft_consensus.cc:740] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.332691 11497 consensus_queue.cc:260] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.332954 11497 ts_tablet_manager.cc:1434] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:00:46.333680 11498 tablet_bootstrap.cc:492] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:46.333773 11498 ts_tablet_manager.cc:1403] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:46.334107 11499 tablet_bootstrap.cc:492] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:46.334332 11498 raft_consensus.cc:359] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.334462 11498 raft_consensus.cc:385] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.334503 11498 raft_consensus.cc:740] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.334672 11498 consensus_queue.cc:260] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.335327 11499 tablet_bootstrap.cc:654] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.335758 11498 ts_tablet_manager.cc:1434] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260502 20:00:46.337461 11499 tablet_bootstrap.cc:492] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:46.337589 11499 ts_tablet_manager.cc:1403] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260502 20:00:46.338121 11499 raft_consensus.cc:359] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.338220 11499 raft_consensus.cc:385] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.338243 11499 raft_consensus.cc:740] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.338385 11499 consensus_queue.cc:260] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.338883 11499 ts_tablet_manager.cc:1434] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:00:46.385309 11503 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:46.385474 11503 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.386137 11503 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:46.386775 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea263d32fd2405985d4514c2ff02a39" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:46.386835 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ea263d32fd2405985d4514c2ff02a39" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:46.387115 11273 raft_consensus.cc:2393] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b85d150f168f406bb31ff44150b2b1a1 in current term 1: Already voted for candidate 858db0bc9f07476e9d1540f2b095414f in this term.
I20260502 20:00:46.387707 11065 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b85d150f168f406bb31ff44150b2b1a1; no voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72
I20260502 20:00:46.388003 11503 raft_consensus.cc:3060] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.412425 11503 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 20:00:46.493604 11524 raft_consensus.cc:493] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:46.493881 11524 raft_consensus.cc:515] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.494495 11524 leader_election.cc:290] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:46.495150 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb15659f8f6549d49f44639345471f6e" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:46.495234 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb15659f8f6549d49f44639345471f6e" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:46.495422 11273 raft_consensus.cc:2468] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:46.495450 11131 raft_consensus.cc:2468] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:46.495837 10933 leader_election.cc:304] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:46.496068 11524 raft_consensus.cc:2804] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:46.496143 11524 raft_consensus.cc:493] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:46.496174 11524 raft_consensus.cc:3060] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.507582 11505 consensus_queue.cc:1048] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:46.512825 11504 consensus_queue.cc:1048] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:46.513741 11505 consensus_queue.cc:1048] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:46.518496 11504 consensus_queue.cc:1048] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:46.559376 11524 raft_consensus.cc:515] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.559971 11524 leader_election.cc:290] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:46.560968 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb15659f8f6549d49f44639345471f6e" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:46.561133 11273 raft_consensus.cc:3060] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.561945 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb15659f8f6549d49f44639345471f6e" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:46.562098 11132 raft_consensus.cc:3060] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.562408 11273 raft_consensus.cc:2468] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:46.562793 10930 leader_election.cc:304] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:46.563066 11524 raft_consensus.cc:2804] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:46.563189 11524 raft_consensus.cc:697] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:46.563271 11132 raft_consensus.cc:2468] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:46.563369 11524 consensus_queue.cc:237] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.741209 11524 consensus_queue.cc:1048] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:46.747895 11505 consensus_queue.cc:1048] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:46.769685 10801 catalog_manager.cc:2174] created HMS catalog entry for table [id=a999550aad204128ae1a88d9b965af8b]
I20260502 20:00:46.775242 10801 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 27) took 2434 ms. Trace:
I20260502 20:00:46.775354 10801 rpcz_store.cc:276] 0502 20:00:44.340258 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:44.340958 (+ 700us) service_pool.cc:224] Handling call
0502 20:00:44.385781 (+ 44823us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:44.386078 (+ 297us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:46.769668 (+2383590us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:46.775014 (+ 5346us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:46.775123 (+ 109us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:46.775222 (+ 99us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:46.770370 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:46.770500 (+ 130us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:46.770504 (+ 4us) write_op.cc:435] Acquired schema lock
0502 20:00:46.770506 (+ 2us) tablet.cc:662] Decoding operations
0502 20:00:46.770584 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:46.770596 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:46.770600 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:46.770666 (+ 66us) tablet.cc:701] Row locks acquired
0502 20:00:46.770667 (+ 1us) write_op.cc:260] PREPARE: finished
0502 20:00:46.770705 (+ 38us) write_op.cc:270] Start()
0502 20:00:46.770736 (+ 31us) write_op.cc:276] Timestamp: P: 1777752046770672 usec, L: 0
0502 20:00:46.770738 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 20:00:46.770906 (+ 168us) log.cc:844] Serialized 432 byte log entry
0502 20:00:46.773832 (+ 2926us) op_driver.cc:464] REPLICATION: finished
0502 20:00:46.773927 (+ 95us) write_op.cc:301] APPLY: starting
0502 20:00:46.773945 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:46.773989 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:46.774200 (+ 211us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:46.774401 (+ 201us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:46.774433 (+ 32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:46.774437 (+ 4us) write_op.cc:312] APPLY: finished
0502 20:00:46.774507 (+ 70us) log.cc:844] Serialized 28 byte log entry
0502 20:00:46.774565 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:46.774580 (+ 15us) write_op.cc:454] Released schema lock
0502 20:00:46.774588 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0502 20:00:46.774654 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:46.774657 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1929042,"Hive Metastore.run_cpu_time_us":251,"Hive Metastore.run_wall_time_us":454321,"spinlock_wait_cycles":26368,"child_traces":[["op",{"apply.queue_time_us":50,"apply.run_cpu_time_us":716,"apply.run_wall_time_us":716,"num_ops":2,"prepare.queue_time_us":70,"prepare.run_cpu_time_us":687,"prepare.run_wall_time_us":697,"raft.queue_time_us":308,"raft.run_cpu_time_us":562,"raft.run_wall_time_us":561,"replication_time_us":3062,"spinlock_wait_cycles":62976}]]}
I20260502 20:00:46.776376 10801 catalog_manager.cc:5671] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to 858db0bc9f07476e9d1540f2b095414f (127.10.27.129). New cstate: current_term: 1 leader_uuid: "858db0bc9f07476e9d1540f2b095414f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:46.776659 10801 catalog_manager.cc:5671] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to 858db0bc9f07476e9d1540f2b095414f (127.10.27.129). New cstate: current_term: 1 leader_uuid: "858db0bc9f07476e9d1540f2b095414f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:46.789543 11112 tablet_service.cc:1511] Processing CreateTablet for tablet 2375695de9014b60b987737fd505b224 (DEFAULT_TABLE table=default.table_11635cffa19740e19919a56d36ca0879 [id=a999550aad204128ae1a88d9b965af8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.789924 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2375695de9014b60b987737fd505b224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.792574 11499 tablet_bootstrap.cc:492] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:46.793612 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 2375695de9014b60b987737fd505b224 (DEFAULT_TABLE table=default.table_11635cffa19740e19919a56d36ca0879 [id=a999550aad204128ae1a88d9b965af8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.793781 11499 tablet_bootstrap.cc:654] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.793918 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2375695de9014b60b987737fd505b224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.796324 11497 tablet_bootstrap.cc:492] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:46.796643 11253 tablet_service.cc:1511] Processing CreateTablet for tablet 2375695de9014b60b987737fd505b224 (DEFAULT_TABLE table=default.table_11635cffa19740e19919a56d36ca0879 [id=a999550aad204128ae1a88d9b965af8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.796937 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2375695de9014b60b987737fd505b224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.797330 11497 tablet_bootstrap.cc:654] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.798619 11497 tablet_bootstrap.cc:492] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:46.798698 11497 ts_tablet_manager.cc:1403] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260502 20:00:46.799345 11497 raft_consensus.cc:359] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.799466 11497 raft_consensus.cc:385] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.799499 11497 raft_consensus.cc:740] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.799634 11497 consensus_queue.cc:260] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.799898 11497 ts_tablet_manager.cc:1434] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:46.800575 11498 tablet_bootstrap.cc:492] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:46.801625 11498 tablet_bootstrap.cc:654] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.803483 11498 tablet_bootstrap.cc:492] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:46.803591 11498 ts_tablet_manager.cc:1403] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:46.804122 11498 raft_consensus.cc:359] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.804272 11498 raft_consensus.cc:385] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.804308 11498 raft_consensus.cc:740] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.804430 11498 consensus_queue.cc:260] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.804718 11498 ts_tablet_manager.cc:1434] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:46.804929 10801 catalog_manager.cc:5671] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to 858db0bc9f07476e9d1540f2b095414f (127.10.27.129). New cstate: current_term: 1 leader_uuid: "858db0bc9f07476e9d1540f2b095414f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:46.806731 11499 tablet_bootstrap.cc:492] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:46.806859 11499 ts_tablet_manager.cc:1403] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.001s
I20260502 20:00:46.807367 11499 raft_consensus.cc:359] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.807487 11499 raft_consensus.cc:385] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.807523 11499 raft_consensus.cc:740] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.807643 11499 consensus_queue.cc:260] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.807945 11499 ts_tablet_manager.cc:1434] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:46.818215 10801 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_92210f99df6644f08ec2076ab59d9a8e" } new_table_name: "default.Table_ac5362bfe46a4090a35bd51ad90c59ad" modify_external_catalogs: true
I20260502 20:00:46.821628 10805 catalog_manager.cc:2174] created HMS catalog entry for table [id=093f23e92a7a48d3bdc662c3b8c38342]
I20260502 20:00:46.825835 10805 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 23) took 2485 ms. Trace:
I20260502 20:00:46.825925 10805 rpcz_store.cc:276] 0502 20:00:44.339996 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:44.341029 (+ 1033us) service_pool.cc:224] Handling call
0502 20:00:44.381785 (+ 40756us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:44.386242 (+ 4457us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:46.821602 (+2435360us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:46.825624 (+ 4022us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:46.825725 (+ 101us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:46.825818 (+ 93us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:46.822183 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:46.822285 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:46.822288 (+ 3us) write_op.cc:435] Acquired schema lock
0502 20:00:46.822289 (+ 1us) tablet.cc:662] Decoding operations
0502 20:00:46.822354 (+ 65us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:46.822362 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:46.822365 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:46.822412 (+ 47us) tablet.cc:701] Row locks acquired
0502 20:00:46.822413 (+ 1us) write_op.cc:260] PREPARE: finished
0502 20:00:46.822439 (+ 26us) write_op.cc:270] Start()
0502 20:00:46.822460 (+ 21us) write_op.cc:276] Timestamp: P: 1777752046822407 usec, L: 0
0502 20:00:46.822462 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 20:00:46.822584 (+ 122us) log.cc:844] Serialized 432 byte log entry
0502 20:00:46.825120 (+ 2536us) op_driver.cc:464] REPLICATION: finished
0502 20:00:46.825223 (+ 103us) write_op.cc:301] APPLY: starting
0502 20:00:46.825240 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:46.825271 (+ 31us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:46.825286 (+ 15us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:46.825360 (+ 74us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:46.825397 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:46.825403 (+ 6us) write_op.cc:312] APPLY: finished
0502 20:00:46.825468 (+ 65us) log.cc:844] Serialized 28 byte log entry
0502 20:00:46.825539 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:46.825556 (+ 17us) write_op.cc:454] Released schema lock
0502 20:00:46.825561 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0502 20:00:46.825627 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:46.825630 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":2383262,"Hive Metastore.run_cpu_time_us":242,"Hive Metastore.run_wall_time_us":51920,"spinlock_wait_cycles":19456,"child_traces":[["op",{"apply.queue_time_us":48,"apply.run_cpu_time_us":403,"apply.run_wall_time_us":402,"mutex_wait_us":129,"num_ops":2,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":533,"prepare.run_wall_time_us":533,"raft.queue_time_us":100,"raft.run_cpu_time_us":573,"raft.run_wall_time_us":572,"replication_time_us":2631,"spinlock_wait_cycles":44544}]]}
I20260502 20:00:46.826381 10805 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_24faf39307584530a038ed30536bd4c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:46.831346 10976 tablet_service.cc:1511] Processing CreateTablet for tablet e6bb822f20154ceb9cf694cbd09b5a77 (DEFAULT_TABLE table=default.table_69320349621b4b9399e4602c5d03321a [id=093f23e92a7a48d3bdc662c3b8c38342]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.831688 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bb822f20154ceb9cf694cbd09b5a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.833612 11497 tablet_bootstrap.cc:492] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:46.834074 11253 tablet_service.cc:1511] Processing CreateTablet for tablet e6bb822f20154ceb9cf694cbd09b5a77 (DEFAULT_TABLE table=default.table_69320349621b4b9399e4602c5d03321a [id=093f23e92a7a48d3bdc662c3b8c38342]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.834415 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bb822f20154ceb9cf694cbd09b5a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.835121 11497 tablet_bootstrap.cc:654] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.836439 11498 tablet_bootstrap.cc:492] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:46.836673 11112 tablet_service.cc:1511] Processing CreateTablet for tablet e6bb822f20154ceb9cf694cbd09b5a77 (DEFAULT_TABLE table=default.table_69320349621b4b9399e4602c5d03321a [id=093f23e92a7a48d3bdc662c3b8c38342]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.836982 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bb822f20154ceb9cf694cbd09b5a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.837670 11498 tablet_bootstrap.cc:654] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.838873 11498 tablet_bootstrap.cc:492] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:46.838990 11498 ts_tablet_manager.cc:1403] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:46.839475 11499 tablet_bootstrap.cc:492] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:46.839501 11498 raft_consensus.cc:359] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.839618 11498 raft_consensus.cc:385] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.839656 11498 raft_consensus.cc:740] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.839787 11498 consensus_queue.cc:260] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.840097 11498 ts_tablet_manager.cc:1434] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:46.840546 11499 tablet_bootstrap.cc:654] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.848631 11499 tablet_bootstrap.cc:492] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:46.848778 11499 ts_tablet_manager.cc:1403] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260502 20:00:46.849372 11499 raft_consensus.cc:359] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.849514 11499 raft_consensus.cc:385] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.849552 11499 raft_consensus.cc:740] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.849730 11499 consensus_queue.cc:260] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.851547 11499 ts_tablet_manager.cc:1434] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 20:00:46.855867 11497 tablet_bootstrap.cc:492] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:46.855988 11497 ts_tablet_manager.cc:1403] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.002s
I20260502 20:00:46.856552 11497 raft_consensus.cc:359] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.856679 11497 raft_consensus.cc:385] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.856715 11497 raft_consensus.cc:740] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.857038 11497 consensus_queue.cc:260] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.857453 11497 ts_tablet_manager.cc:1434] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260502 20:00:46.868090 10798 catalog_manager.cc:2174] created HMS catalog entry for table [id=c0ef35bd37c5491084f6c10c673cf87b]
I20260502 20:00:46.873517 10798 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 30) took 2533 ms. Trace:
I20260502 20:00:46.873638 10798 rpcz_store.cc:276] 0502 20:00:44.340451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:44.340539 (+ 88us) service_pool.cc:224] Handling call
0502 20:00:44.387061 (+ 46522us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:44.387371 (+ 310us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:46.868075 (+2480704us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:46.873304 (+ 5229us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:46.873411 (+ 107us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:46.873496 (+ 85us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:46.868727 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:46.869159 (+ 432us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:46.869167 (+ 8us) write_op.cc:435] Acquired schema lock
0502 20:00:46.869169 (+ 2us) tablet.cc:662] Decoding operations
0502 20:00:46.869272 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:46.869286 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:46.869290 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:46.869371 (+ 81us) tablet.cc:701] Row locks acquired
0502 20:00:46.869372 (+ 1us) write_op.cc:260] PREPARE: finished
0502 20:00:46.869434 (+ 62us) write_op.cc:270] Start()
0502 20:00:46.869472 (+ 38us) write_op.cc:276] Timestamp: P: 1777752046869384 usec, L: 0
0502 20:00:46.869473 (+ 1us) op_driver.cc:348] REPLICATION: starting
0502 20:00:46.869700 (+ 227us) log.cc:844] Serialized 432 byte log entry
0502 20:00:46.872756 (+ 3056us) op_driver.cc:464] REPLICATION: finished
0502 20:00:46.872863 (+ 107us) write_op.cc:301] APPLY: starting
0502 20:00:46.872883 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:46.872920 (+ 37us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:46.872936 (+ 16us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:46.873024 (+ 88us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:46.873070 (+ 46us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:46.873075 (+ 5us) write_op.cc:312] APPLY: finished
0502 20:00:46.873146 (+ 71us) log.cc:844] Serialized 28 byte log entry
0502 20:00:46.873202 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:46.873226 (+ 24us) write_op.cc:454] Released schema lock
0502 20:00:46.873234 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0502 20:00:46.873306 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:46.873308 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":2434076,"Hive Metastore.run_cpu_time_us":288,"Hive Metastore.run_wall_time_us":46500,"mutex_wait_us":1226,"child_traces":[["op",{"apply.queue_time_us":63,"apply.run_cpu_time_us":432,"apply.run_wall_time_us":431,"num_ops":2,"prepare.queue_time_us":89,"prepare.run_cpu_time_us":1304,"prepare.run_wall_time_us":1304,"raft.queue_time_us":423,"raft.run_cpu_time_us":476,"raft.run_wall_time_us":476,"replication_time_us":3250}]]}
I20260502 20:00:46.880591 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 9402b710e18247e4abc7a69be19c4afe (DEFAULT_TABLE table=default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.880782 11112 tablet_service.cc:1511] Processing CreateTablet for tablet 9402b710e18247e4abc7a69be19c4afe (DEFAULT_TABLE table=default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.880926 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9402b710e18247e4abc7a69be19c4afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.881024 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9402b710e18247e4abc7a69be19c4afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.882086 10798 master_service.cc:954] ReplaceTablet: received request to replace tablet 82ccb69e9f7b48178ca59455bb46bb65 from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:46.883219 11499 tablet_bootstrap.cc:492] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:46.883649 11497 tablet_bootstrap.cc:492] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:46.884639 11499 tablet_bootstrap.cc:654] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.885063 11497 tablet_bootstrap.cc:654] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.886312 11499 tablet_bootstrap.cc:492] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:46.886423 11499 ts_tablet_manager.cc:1403] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260502 20:00:46.887729 11253 tablet_service.cc:1511] Processing CreateTablet for tablet 9402b710e18247e4abc7a69be19c4afe (DEFAULT_TABLE table=default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.887799 11499 raft_consensus.cc:359] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.887915 11499 raft_consensus.cc:385] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.887946 11499 raft_consensus.cc:740] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.888082 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9402b710e18247e4abc7a69be19c4afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.888120 11499 consensus_queue.cc:260] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.889103 11499 ts_tablet_manager.cc:1434] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 20:00:46.890656 11498 tablet_bootstrap.cc:492] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:46.891795 11498 tablet_bootstrap.cc:654] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.894249 11498 tablet_bootstrap.cc:492] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:46.894356 11498 ts_tablet_manager.cc:1403] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 20:00:46.894860 11498 raft_consensus.cc:359] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.895035 11498 raft_consensus.cc:385] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.895190 11498 raft_consensus.cc:740] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.895337 11498 consensus_queue.cc:260] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.896422 10798 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet 82ccb69e9f7b48178ca59455bb46bb65
I20260502 20:00:46.896790 10798 catalog_manager.cc:6741] ReplaceTablet: tablet 82ccb69e9f7b48178ca59455bb46bb65 deleted and replaced by tablet b7f66a29d42c416b93bf9ec89fd53e98
I20260502 20:00:46.897254 10976 tablet_service.cc:1558] Processing DeleteTablet for tablet 82ccb69e9f7b48178ca59455bb46bb65 with delete_type TABLET_DATA_DELETED (replaced by tablet b7f66a29d42c416b93bf9ec89fd53e98) from {username='slave'} at 127.0.0.1:38494
I20260502 20:00:46.897886 11112 tablet_service.cc:1558] Processing DeleteTablet for tablet 82ccb69e9f7b48178ca59455bb46bb65 with delete_type TABLET_DATA_DELETED (replaced by tablet b7f66a29d42c416b93bf9ec89fd53e98) from {username='slave'} at 127.0.0.1:36722
I20260502 20:00:46.898274 10798 master_service.cc:954] ReplaceTablet: received request to replace tablet 82ccb69e9f7b48178ca59455bb46bb65 from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:46.898643 11253 tablet_service.cc:1558] Processing DeleteTablet for tablet 82ccb69e9f7b48178ca59455bb46bb65 with delete_type TABLET_DATA_DELETED (replaced by tablet b7f66a29d42c416b93bf9ec89fd53e98) from {username='slave'} at 127.0.0.1:54214
I20260502 20:00:46.898741 10798 master_service.cc:954] ReplaceTablet: received request to replace tablet 82ccb69e9f7b48178ca59455bb46bb65 from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:46.899150 10798 master_service.cc:954] ReplaceTablet: received request to replace tablet 60b6d72589a9465692d851093aef3cb8 from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:46.902289 11498 ts_tablet_manager.cc:1434] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260502 20:00:46.904691 11112 tablet_service.cc:1511] Processing CreateTablet for tablet b7f66a29d42c416b93bf9ec89fd53e98 (DEFAULT_TABLE table=default.table_ca365f139e204571a925ae336a6fd2fd [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.905117 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f66a29d42c416b93bf9ec89fd53e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.907873 10976 tablet_service.cc:1511] Processing CreateTablet for tablet b7f66a29d42c416b93bf9ec89fd53e98 (DEFAULT_TABLE table=default.table_ca365f139e204571a925ae336a6fd2fd [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.907927 11505 consensus_queue.cc:1048] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:46.908175 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f66a29d42c416b93bf9ec89fd53e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.912808 11524 consensus_queue.cc:1048] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:46.913502 11253 tablet_service.cc:1511] Processing CreateTablet for tablet b7f66a29d42c416b93bf9ec89fd53e98 (DEFAULT_TABLE table=default.table_ca365f139e204571a925ae336a6fd2fd [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.913807 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f66a29d42c416b93bf9ec89fd53e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.917273 11498 tablet_bootstrap.cc:492] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:46.918507 11498 tablet_bootstrap.cc:654] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.919111 10798 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet 60b6d72589a9465692d851093aef3cb8
I20260502 20:00:46.919795 11111 tablet_service.cc:1558] Processing DeleteTablet for tablet 60b6d72589a9465692d851093aef3cb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d82a249a8664df98444dbe25dd27cc4) from {username='slave'} at 127.0.0.1:36722
I20260502 20:00:46.920112 10798 catalog_manager.cc:6741] ReplaceTablet: tablet 60b6d72589a9465692d851093aef3cb8 deleted and replaced by tablet 7d82a249a8664df98444dbe25dd27cc4
I20260502 20:00:46.920797 10976 tablet_service.cc:1558] Processing DeleteTablet for tablet 60b6d72589a9465692d851093aef3cb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d82a249a8664df98444dbe25dd27cc4) from {username='slave'} at 127.0.0.1:38494
I20260502 20:00:46.921111 11253 tablet_service.cc:1558] Processing DeleteTablet for tablet 60b6d72589a9465692d851093aef3cb8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d82a249a8664df98444dbe25dd27cc4) from {username='slave'} at 127.0.0.1:54214
I20260502 20:00:46.922847 11498 tablet_bootstrap.cc:492] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:46.923616 11499 tablet_bootstrap.cc:492] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:46.923795 11503 raft_consensus.cc:493] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:46.923899 11503 raft_consensus.cc:515] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.924289 11503 leader_election.cc:290] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:46.924974 11499 tablet_bootstrap.cc:654] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.925483 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bb822f20154ceb9cf694cbd09b5a77" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:46.925632 10982 raft_consensus.cc:2468] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:46.926512 11499 tablet_bootstrap.cc:492] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:46.926594 11499 ts_tablet_manager.cc:1403] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260502 20:00:46.926771 11065 leader_election.cc:304] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:46.927004 11503 raft_consensus.cc:2804] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:46.927053 11503 raft_consensus.cc:493] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:46.927088 11503 raft_consensus.cc:3060] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.928120 11503 raft_consensus.cc:515] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.928375 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 7d82a249a8664df98444dbe25dd27cc4 (DEFAULT_TABLE table=default.table_374d681ae8634e8a85619deb2997bb74 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.928516 11503 leader_election.cc:290] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:46.928680 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d82a249a8664df98444dbe25dd27cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.928814 11111 tablet_service.cc:1511] Processing CreateTablet for tablet 7d82a249a8664df98444dbe25dd27cc4 (DEFAULT_TABLE table=default.table_374d681ae8634e8a85619deb2997bb74 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.929080 11111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d82a249a8664df98444dbe25dd27cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.929282 11499 raft_consensus.cc:359] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.929400 11499 raft_consensus.cc:385] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.929432 11499 raft_consensus.cc:740] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.930088 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bb822f20154ceb9cf694cbd09b5a77" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:46.930207 10982 raft_consensus.cc:3060] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.931165 10982 raft_consensus.cc:2468] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:46.932417 11499 consensus_queue.cc:260] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.932772 11065 leader_election.cc:304] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:46.933434 11503 raft_consensus.cc:2804] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:46.933485 10798 master_service.cc:954] ReplaceTablet: received request to replace tablet 60b6d72589a9465692d851093aef3cb8 from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:46.933692 11503 raft_consensus.cc:697] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:46.933807 10798 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_80d254b59aeb4715a2c7c15eaa36d97d" } new_table_name: "default.Table_35a03681af3042babb0e601163d9fe20" modify_external_catalogs: true
I20260502 20:00:46.933934 11503 consensus_queue.cc:237] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.932785 11499 ts_tablet_manager.cc:1434] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260502 20:00:46.936172 11499 tablet_bootstrap.cc:492] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:46.924811 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bb822f20154ceb9cf694cbd09b5a77" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:46.937037 11273 raft_consensus.cc:2468] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:46.929106 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bb822f20154ceb9cf694cbd09b5a77" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:46.937542 11272 raft_consensus.cc:3060] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.939066 11272 raft_consensus.cc:2468] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:46.936702 11253 tablet_service.cc:1511] Processing CreateTablet for tablet 7d82a249a8664df98444dbe25dd27cc4 (DEFAULT_TABLE table=default.table_374d681ae8634e8a85619deb2997bb74 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.939716 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d82a249a8664df98444dbe25dd27cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.939874 11499 tablet_bootstrap.cc:654] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.942009 11499 tablet_bootstrap.cc:492] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:46.942127 11499 ts_tablet_manager.cc:1403] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260502 20:00:46.942337 11498 ts_tablet_manager.cc:1403] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.003s
I20260502 20:00:46.942798 11499 raft_consensus.cc:359] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.942915 11499 raft_consensus.cc:385] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.942974 11499 raft_consensus.cc:740] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.943105 11498 raft_consensus.cc:359] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.943152 11499 consensus_queue.cc:260] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.943336 11498 raft_consensus.cc:385] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.943413 11498 raft_consensus.cc:740] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.943578 11499 ts_tablet_manager.cc:1434] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:00:46.943606 11498 consensus_queue.cc:260] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.944132 11498 ts_tablet_manager.cc:1434] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260502 20:00:46.944367 11498 tablet_bootstrap.cc:492] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:46.945811 11498 tablet_bootstrap.cc:654] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.946545 11555 tablet_replica.cc:333] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:46.946772 11555 raft_consensus.cc:2243] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:46.946998 11498 tablet_bootstrap.cc:492] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:46.947088 11498 ts_tablet_manager.cc:1403] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260502 20:00:46.947397 11555 raft_consensus.cc:2272] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:46.947588 11498 raft_consensus.cc:359] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.947693 11498 raft_consensus.cc:385] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.947722 11498 raft_consensus.cc:740] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.947837 11498 consensus_queue.cc:260] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.948150 11498 ts_tablet_manager.cc:1434] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:00:46.948534 11555 ts_tablet_manager.cc:1916] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:46.951253 11555 ts_tablet_manager.cc:1929] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:46.951416 11555 log.cc:1199] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/82ccb69e9f7b48178ca59455bb46bb65
I20260502 20:00:46.951665 11557 tablet_replica.cc:333] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:46.951560 11497 tablet_bootstrap.cc:492] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:46.951866 11497 ts_tablet_manager.cc:1403] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.068s user 0.002s sys 0.001s
I20260502 20:00:46.952397 11497 raft_consensus.cc:359] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.952478 11497 raft_consensus.cc:385] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.952499 11497 raft_consensus.cc:740] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.952637 11497 consensus_queue.cc:260] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.952922 11497 ts_tablet_manager.cc:1434] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:46.953244 11497 tablet_bootstrap.cc:492] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:46.954304 11497 tablet_bootstrap.cc:654] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.955698 11555 ts_tablet_manager.cc:1950] T 82ccb69e9f7b48178ca59455bb46bb65 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:46.955874 11557 raft_consensus.cc:2243] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:46.956053 11557 raft_consensus.cc:2272] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:46.957558 10790 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet 82ccb69e9f7b48178ca59455bb46bb65 (table default.table_ca365f139e204571a925ae336a6fd2fd [id=4ce433e96065488abd346ff7bb660464]) successfully deleted
I20260502 20:00:46.958073 11555 tablet_replica.cc:333] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:46.959013 11557 ts_tablet_manager.cc:1916] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:46.959237 11555 raft_consensus.cc:2243] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:46.964721 11555 raft_consensus.cc:2272] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:46.965401 11555 ts_tablet_manager.cc:1916] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:46.965477 10804 catalog_manager.cc:2174] created HMS catalog entry for table [id=30cd302de7a94d7e8623f809030f7c7e]
I20260502 20:00:46.966921 11556 tablet_replica.cc:333] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:46.967154 11556 raft_consensus.cc:2243] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:46.967321 11556 raft_consensus.cc:2272] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:46.968674 11555 ts_tablet_manager.cc:1929] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:46.968756 11555 log.cc:1199] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/60b6d72589a9465692d851093aef3cb8
I20260502 20:00:46.969023 11555 ts_tablet_manager.cc:1950] T 60b6d72589a9465692d851093aef3cb8 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:46.969277 11556 ts_tablet_manager.cc:1916] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:46.961923 11557 ts_tablet_manager.cc:1929] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:46.969527 11557 log.cc:1199] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/82ccb69e9f7b48178ca59455bb46bb65
I20260502 20:00:46.970005 11497 tablet_bootstrap.cc:492] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:46.970043 10804 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 24) took 2629 ms. Trace:
I20260502 20:00:46.970185 11497 ts_tablet_manager.cc:1403] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20260502 20:00:46.970185 10804 rpcz_store.cc:276] 0502 20:00:44.340064 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:44.340125 (+ 61us) service_pool.cc:224] Handling call
0502 20:00:44.387288 (+ 47163us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:44.387624 (+ 336us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:46.965468 (+2577844us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:46.969830 (+ 4362us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:46.969942 (+ 112us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:46.970027 (+ 85us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:46.965971 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:46.966075 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:46.966079 (+ 4us) write_op.cc:435] Acquired schema lock
0502 20:00:46.966080 (+ 1us) tablet.cc:662] Decoding operations
0502 20:00:46.966147 (+ 67us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:46.966156 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:46.966160 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:46.966213 (+ 53us) tablet.cc:701] Row locks acquired
0502 20:00:46.966214 (+ 1us) write_op.cc:260] PREPARE: finished
0502 20:00:46.966245 (+ 31us) write_op.cc:270] Start()
0502 20:00:46.966274 (+ 29us) write_op.cc:276] Timestamp: P: 1777752046966201 usec, L: 0
0502 20:00:46.966276 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 20:00:46.966424 (+ 148us) log.cc:844] Serialized 432 byte log entry
0502 20:00:46.969312 (+ 2888us) op_driver.cc:464] REPLICATION: finished
0502 20:00:46.969449 (+ 137us) write_op.cc:301] APPLY: starting
0502 20:00:46.969469 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:46.969499 (+ 30us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:46.969515 (+ 16us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:46.969590 (+ 75us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:46.969620 (+ 30us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:46.969624 (+ 4us) write_op.cc:312] APPLY: finished
0502 20:00:46.969687 (+ 63us) log.cc:844] Serialized 28 byte log entry
0502 20:00:46.969742 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:46.969754 (+ 12us) write_op.cc:454] Released schema lock
0502 20:00:46.969760 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0502 20:00:46.969831 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:46.969834 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":2480369,"Hive Metastore.run_cpu_time_us":275,"Hive Metastore.run_wall_time_us":97305,"mutex_wait_us":1987,"spinlock_wait_cycles":4864,"child_traces":[["op",{"apply.queue_time_us":93,"apply.run_cpu_time_us":374,"apply.run_wall_time_us":373,"num_ops":2,"prepare.queue_time_us":41,"prepare.run_cpu_time_us":566,"prepare.run_wall_time_us":567,"raft.queue_time_us":112,"raft.run_cpu_time_us":499,"raft.run_wall_time_us":498,"replication_time_us":3005,"spinlock_wait_cycles":82048}]]}
I20260502 20:00:46.970693 11497 raft_consensus.cc:359] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.970805 11497 raft_consensus.cc:385] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.970839 11497 raft_consensus.cc:740] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.970996 11497 consensus_queue.cc:260] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.971369 11497 ts_tablet_manager.cc:1434] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:46.971580 11497 tablet_bootstrap.cc:492] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:46.972708 11497 tablet_bootstrap.cc:654] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.973212 10804 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_8f233da2ffa04623bc614dc8d7d8e51c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:46.979285 11536 raft_consensus.cc:493] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:46.979383 11536 raft_consensus.cc:515] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.979784 11536 leader_election.cc:290] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:46.980149 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2375695de9014b60b987737fd505b224" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:46.980294 11132 raft_consensus.cc:2468] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:46.980600 10933 leader_election.cc:304] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:46.981091 11536 raft_consensus.cc:2804] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:46.981153 11536 raft_consensus.cc:493] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:46.981200 11536 raft_consensus.cc:3060] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.979149 11521 raft_consensus.cc:493] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:46.981356 11521 raft_consensus.cc:515] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.981758 11521 leader_election.cc:290] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:46.980968 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2375695de9014b60b987737fd505b224" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:46.982278 11272 raft_consensus.cc:2468] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:46.982362 11536 raft_consensus.cc:515] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.982597 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f66a29d42c416b93bf9ec89fd53e98" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:46.982710 11536 leader_election.cc:290] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:46.982726 11132 raft_consensus.cc:2468] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:46.983104 11209 leader_election.cc:304] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:46.983409 11112 tablet_service.cc:1511] Processing CreateTablet for tablet 45f65f428a604ab4b8baa081c2960243 (DEFAULT_TABLE table=default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.983721 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f65f428a604ab4b8baa081c2960243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.983814 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f66a29d42c416b93bf9ec89fd53e98" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:46.983932 10982 raft_consensus.cc:2468] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:46.984788 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2375695de9014b60b987737fd505b224" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:46.984902 11272 raft_consensus.cc:3060] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.985733 11556 ts_tablet_manager.cc:1929] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:46.985811 11556 log.cc:1199] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/82ccb69e9f7b48178ca59455bb46bb65
I20260502 20:00:46.985872 11272 raft_consensus.cc:2468] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:46.985973 11499 tablet_bootstrap.cc:492] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:46.986092 11521 raft_consensus.cc:2804] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:46.986152 11521 raft_consensus.cc:493] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:46.986202 11521 raft_consensus.cc:3060] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.986469 11556 ts_tablet_manager.cc:1950] T 82ccb69e9f7b48178ca59455bb46bb65 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:46.987121 11499 tablet_bootstrap.cc:654] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.987197 11521 raft_consensus.cc:515] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.987504 10793 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet 82ccb69e9f7b48178ca59455bb46bb65 (table default.table_ca365f139e204571a925ae336a6fd2fd [id=4ce433e96065488abd346ff7bb660464]) successfully deleted
I20260502 20:00:46.987614 11521 leader_election.cc:290] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:46.987124 11556 tablet_replica.cc:333] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:46.987823 11556 raft_consensus.cc:2243] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:46.987946 11556 raft_consensus.cc:2272] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:46.988144 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2375695de9014b60b987737fd505b224" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:46.988267 11132 raft_consensus.cc:3060] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.988534 11556 ts_tablet_manager.cc:1916] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:46.988571 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f66a29d42c416b93bf9ec89fd53e98" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:46.988677 11131 raft_consensus.cc:3060] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.989189 11132 raft_consensus.cc:2468] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:46.989686 11131 raft_consensus.cc:2468] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:46.989825 10930 leader_election.cc:304] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:46.990007 11536 raft_consensus.cc:2804] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:46.990168 11536 raft_consensus.cc:697] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:46.990186 11209 leader_election.cc:304] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:46.990262 11253 tablet_service.cc:1511] Processing CreateTablet for tablet 45f65f428a604ab4b8baa081c2960243 (DEFAULT_TABLE table=default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.990317 11536 consensus_queue.cc:237] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.990578 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f65f428a604ab4b8baa081c2960243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.990964 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 45f65f428a604ab4b8baa081c2960243 (DEFAULT_TABLE table=default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:46.991326 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f65f428a604ab4b8baa081c2960243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:46.993551 11498 tablet_bootstrap.cc:492] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:46.993583 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f66a29d42c416b93bf9ec89fd53e98" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:46.993688 10982 raft_consensus.cc:3060] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:46.994367 11556 ts_tablet_manager.cc:1929] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:46.994441 11556 log.cc:1199] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/60b6d72589a9465692d851093aef3cb8
I20260502 20:00:46.994585 10982 raft_consensus.cc:2468] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:46.994611 11498 tablet_bootstrap.cc:654] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:46.994704 11556 ts_tablet_manager.cc:1950] T 60b6d72589a9465692d851093aef3cb8 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:46.996089 10793 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet 60b6d72589a9465692d851093aef3cb8 (table default.table_374d681ae8634e8a85619deb2997bb74 [id=7f99eb7719134a54a8f42be5b8c48760]) successfully deleted
I20260502 20:00:46.997058 11521 raft_consensus.cc:2804] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:46.997152 11521 raft_consensus.cc:697] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Becoming Leader. State: Replica: ade741c4062940adb2223b55187ffe72, State: Running, Role: LEADER
I20260502 20:00:46.997311 11499 tablet_bootstrap.cc:492] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:46.997280 11521 consensus_queue.cc:237] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.997390 11499 ts_tablet_manager.cc:1403] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.001s
I20260502 20:00:46.997875 11499 raft_consensus.cc:359] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.997979 11499 raft_consensus.cc:385] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:46.998018 11499 raft_consensus.cc:740] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:46.998145 11499 consensus_queue.cc:260] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:46.998426 11499 ts_tablet_manager.cc:1434] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:46.999308 11498 tablet_bootstrap.cc:492] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:46.999395 11498 ts_tablet_manager.cc:1403] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260502 20:00:46.999925 11498 raft_consensus.cc:359] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.000025 11498 raft_consensus.cc:385] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.000061 11498 raft_consensus.cc:740] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.000182 11498 consensus_queue.cc:260] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.000535 11498 ts_tablet_manager.cc:1434] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:00:47.001547 10790 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet 60b6d72589a9465692d851093aef3cb8 (table default.table_374d681ae8634e8a85619deb2997bb74 [id=7f99eb7719134a54a8f42be5b8c48760]) successfully deleted
I20260502 20:00:47.003980 11557 ts_tablet_manager.cc:1950] T 82ccb69e9f7b48178ca59455bb46bb65 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:47.004763 11557 tablet_replica.cc:333] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:47.004839 10790 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet 82ccb69e9f7b48178ca59455bb46bb65 (table default.table_ca365f139e204571a925ae336a6fd2fd [id=4ce433e96065488abd346ff7bb660464]) successfully deleted
I20260502 20:00:47.005048 11557 raft_consensus.cc:2243] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:47.005194 11557 raft_consensus.cc:2272] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:47.006156 11557 ts_tablet_manager.cc:1916] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:47.006218 11497 tablet_bootstrap.cc:492] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:47.006316 11497 ts_tablet_manager.cc:1403] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
I20260502 20:00:47.006877 11497 raft_consensus.cc:359] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.007368 11497 raft_consensus.cc:385] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.007436 11497 raft_consensus.cc:740] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.007609 11497 consensus_queue.cc:260] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.008975 11497 ts_tablet_manager.cc:1434] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:47.009317 11497 tablet_bootstrap.cc:492] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:47.010453 11497 tablet_bootstrap.cc:654] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.012787 11557 ts_tablet_manager.cc:1929] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:47.012862 11557 log.cc:1199] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/60b6d72589a9465692d851093aef3cb8
I20260502 20:00:47.013116 11557 ts_tablet_manager.cc:1950] T 60b6d72589a9465692d851093aef3cb8 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:47.014894 10790 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet 60b6d72589a9465692d851093aef3cb8 (table default.table_374d681ae8634e8a85619deb2997bb74 [id=7f99eb7719134a54a8f42be5b8c48760]) successfully deleted
I20260502 20:00:47.015847 11497 tablet_bootstrap.cc:492] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:47.015975 11497 ts_tablet_manager.cc:1403] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260502 20:00:47.016494 11497 raft_consensus.cc:359] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.016618 11497 raft_consensus.cc:385] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.016659 11497 raft_consensus.cc:740] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.016794 11497 consensus_queue.cc:260] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.017076 11497 ts_tablet_manager.cc:1434] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:47.026507 10803 catalog_manager.cc:2174] created HMS catalog entry for table [id=a0a56f4db1d84c11963490879dc9d66f]
I20260502 20:00:47.030797 10803 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 25) took 2690 ms. Trace:
I20260502 20:00:47.030884 10803 rpcz_store.cc:276] 0502 20:00:44.340142 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:44.341800 (+ 1658us) service_pool.cc:224] Handling call
0502 20:00:44.387411 (+ 45611us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:44.387681 (+ 270us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:47.026496 (+2638815us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:47.030610 (+ 4114us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:47.030703 (+ 93us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:47.030779 (+ 76us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:47.027156 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:47.027269 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:47.027273 (+ 4us) write_op.cc:435] Acquired schema lock
0502 20:00:47.027275 (+ 2us) tablet.cc:662] Decoding operations
0502 20:00:47.027346 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:47.027355 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:47.027359 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:47.027417 (+ 58us) tablet.cc:701] Row locks acquired
0502 20:00:47.027419 (+ 2us) write_op.cc:260] PREPARE: finished
0502 20:00:47.027452 (+ 33us) write_op.cc:270] Start()
0502 20:00:47.027479 (+ 27us) write_op.cc:276] Timestamp: P: 1777752047027402 usec, L: 0
0502 20:00:47.027481 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 20:00:47.027628 (+ 147us) log.cc:844] Serialized 432 byte log entry
0502 20:00:47.029831 (+ 2203us) op_driver.cc:464] REPLICATION: finished
0502 20:00:47.029911 (+ 80us) write_op.cc:301] APPLY: starting
0502 20:00:47.029925 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:47.029956 (+ 31us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:47.029970 (+ 14us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:47.030073 (+ 103us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:47.030102 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:47.030106 (+ 4us) write_op.cc:312] APPLY: finished
0502 20:00:47.030166 (+ 60us) log.cc:844] Serialized 28 byte log entry
0502 20:00:47.030226 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:47.030237 (+ 11us) write_op.cc:454] Released schema lock
0502 20:00:47.030241 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0502 20:00:47.030304 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:47.030306 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":2577692,"Hive Metastore.run_cpu_time_us":211,"Hive Metastore.run_wall_time_us":60881,"spinlock_wait_cycles":63872,"child_traces":[["op",{"apply.queue_time_us":43,"apply.run_cpu_time_us":376,"apply.run_wall_time_us":376,"num_ops":2,"prepare.queue_time_us":50,"prepare.run_cpu_time_us":598,"prepare.run_wall_time_us":598,"raft.queue_time_us":392,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":419,"replication_time_us":2324,"spinlock_wait_cycles":1920}]]}
I20260502 20:00:47.031984 10803 catalog_manager.cc:5671] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130). New cstate: current_term: 1 leader_uuid: "b85d150f168f406bb31ff44150b2b1a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:47.042968 11112 tablet_service.cc:1511] Processing CreateTablet for tablet c671b41464b74cd1bfcec7eb52043bd3 (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.043239 10976 tablet_service.cc:1511] Processing CreateTablet for tablet c671b41464b74cd1bfcec7eb52043bd3 (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.043341 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c671b41464b74cd1bfcec7eb52043bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.043506 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c671b41464b74cd1bfcec7eb52043bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.045531 11497 tablet_bootstrap.cc:492] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:47.045531 11499 tablet_bootstrap.cc:492] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:47.045666 11253 tablet_service.cc:1511] Processing CreateTablet for tablet c671b41464b74cd1bfcec7eb52043bd3 (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.045954 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c671b41464b74cd1bfcec7eb52043bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.046679 11499 tablet_bootstrap.cc:654] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.046751 11497 tablet_bootstrap.cc:654] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.047968 11524 consensus_queue.cc:1048] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.048331 11497 tablet_bootstrap.cc:492] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:47.048411 11497 ts_tablet_manager.cc:1403] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:47.048455 11499 tablet_bootstrap.cc:492] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:47.048528 11499 ts_tablet_manager.cc:1403] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260502 20:00:47.048583 11498 tablet_bootstrap.cc:492] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:47.048879 11497 raft_consensus.cc:359] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.049010 11497 raft_consensus.cc:385] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.048941 11499 raft_consensus.cc:359] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.049048 11497 raft_consensus.cc:740] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.049055 11499 raft_consensus.cc:385] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.049089 11499 raft_consensus.cc:740] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.049190 11497 consensus_queue.cc:260] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.049497 11497 ts_tablet_manager.cc:1434] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:00:47.049568 11498 tablet_bootstrap.cc:654] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.052318 11499 consensus_queue.cc:260] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.053851 11499 ts_tablet_manager.cc:1434] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260502 20:00:47.055070 11505 consensus_queue.cc:1048] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 20:00:47.057492 10799 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_41826ad67ed540e0a427cd0347407518 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:47.058288 10802 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_54d68ed8aef94a978c1ad2a5e5312cab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:47.058956 10805 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_24faf39307584530a038ed30536bd4c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:47.059581 10804 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8f233da2ffa04623bc614dc8d7d8e51c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260502 20:00:47.063436 11498 tablet_bootstrap.cc:492] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:47.063548 11498 ts_tablet_manager.cc:1403] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20260502 20:00:47.064116 11498 raft_consensus.cc:359] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.064245 11498 raft_consensus.cc:385] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.064288 11498 raft_consensus.cc:740] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.064420 11498 consensus_queue.cc:260] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.064726 11498 ts_tablet_manager.cc:1434] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:47.064697 10803 catalog_manager.cc:5671] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to 858db0bc9f07476e9d1540f2b095414f (127.10.27.129). New cstate: current_term: 1 leader_uuid: "858db0bc9f07476e9d1540f2b095414f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:47.073385 10803 catalog_manager.cc:5671] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 reported cstate change: term changed from 0 to 1, leader changed from <none> to ade741c4062940adb2223b55187ffe72 (127.10.27.131). New cstate: current_term: 1 leader_uuid: "ade741c4062940adb2223b55187ffe72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260502 20:00:47.081499 10803 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_e3ad181715724e36aa7276f9790d41bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:47.144287 11505 raft_consensus.cc:493] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:47.144462 11505 raft_consensus.cc:515] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.144934 11505 leader_election.cc:290] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:47.145715 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d82a249a8664df98444dbe25dd27cc4" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:47.145865 11272 raft_consensus.cc:2468] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:47.146615 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d82a249a8664df98444dbe25dd27cc4" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:47.146767 11131 raft_consensus.cc:2468] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:47.147382 10930 leader_election.cc:304] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:47.147819 11505 raft_consensus.cc:2804] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:47.147877 11505 raft_consensus.cc:493] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:47.147914 11505 raft_consensus.cc:3060] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.149019 11505 raft_consensus.cc:515] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.149394 11505 leader_election.cc:290] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:47.149936 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d82a249a8664df98444dbe25dd27cc4" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:47.150069 11131 raft_consensus.cc:3060] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.151393 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d82a249a8664df98444dbe25dd27cc4" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:47.151515 11272 raft_consensus.cc:3060] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.152539 11272 raft_consensus.cc:2468] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:47.152865 11503 raft_consensus.cc:493] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:47.152951 11503 raft_consensus.cc:515] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.153333 11503 leader_election.cc:290] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:47.153725 10930 leader_election.cc:304] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:47.153779 11131 raft_consensus.cc:2468] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:47.154206 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c671b41464b74cd1bfcec7eb52043bd3" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:47.154234 11505 raft_consensus.cc:2804] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:47.154325 10982 raft_consensus.cc:2468] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:47.154386 11505 raft_consensus.cc:697] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:47.154520 11505 consensus_queue.cc:237] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.154601 11065 leader_election.cc:304] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:47.154809 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c671b41464b74cd1bfcec7eb52043bd3" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:47.154949 11272 raft_consensus.cc:2468] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:47.155439 11503 raft_consensus.cc:2804] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:47.155494 11503 raft_consensus.cc:493] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:47.155555 11503 raft_consensus.cc:3060] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.156504 11503 raft_consensus.cc:515] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.156847 11503 leader_election.cc:290] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:47.157545 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c671b41464b74cd1bfcec7eb52043bd3" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:47.157656 10982 raft_consensus.cc:3060] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.159332 10982 raft_consensus.cc:2468] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:47.159747 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c671b41464b74cd1bfcec7eb52043bd3" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:47.159876 11272 raft_consensus.cc:3060] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.160857 11272 raft_consensus.cc:2468] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:47.161221 11065 leader_election.cc:304] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:47.161556 11503 raft_consensus.cc:2804] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:47.161635 11503 raft_consensus.cc:697] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:47.161772 11503 consensus_queue.cc:237] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.214362 11503 raft_consensus.cc:493] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:47.214535 11503 raft_consensus.cc:515] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.215083 11503 leader_election.cc:290] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:47.215603 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9402b710e18247e4abc7a69be19c4afe" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:47.215754 10982 raft_consensus.cc:2468] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:47.216003 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9402b710e18247e4abc7a69be19c4afe" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:47.216112 11065 leader_election.cc:304] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:47.216145 11272 raft_consensus.cc:2468] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:47.216317 11503 raft_consensus.cc:2804] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:47.216367 11503 raft_consensus.cc:493] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:47.216401 11503 raft_consensus.cc:3060] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.217394 11503 raft_consensus.cc:515] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.217753 11503 leader_election.cc:290] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:47.218220 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9402b710e18247e4abc7a69be19c4afe" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:47.218340 11272 raft_consensus.cc:3060] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.219229 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9402b710e18247e4abc7a69be19c4afe" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:47.219357 10982 raft_consensus.cc:3060] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.219645 11272 raft_consensus.cc:2468] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:47.220011 11065 leader_election.cc:304] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:47.220186 11503 raft_consensus.cc:2804] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:47.220278 11503 raft_consensus.cc:697] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:47.220376 10982 raft_consensus.cc:2468] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:47.220453 11503 consensus_queue.cc:237] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.236694 11503 raft_consensus.cc:493] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:47.236829 11503 raft_consensus.cc:515] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.237242 11503 leader_election.cc:290] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:47.237848 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f65f428a604ab4b8baa081c2960243" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:47.237993 10982 raft_consensus.cc:2468] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:47.238144 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f65f428a604ab4b8baa081c2960243" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:47.238301 11272 raft_consensus.cc:2468] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:47.238785 11065 leader_election.cc:304] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:47.239130 11503 raft_consensus.cc:2804] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:47.239184 11503 raft_consensus.cc:493] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:47.239224 11503 raft_consensus.cc:3060] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.240239 11503 raft_consensus.cc:515] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.240592 11503 leader_election.cc:290] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:47.241274 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f65f428a604ab4b8baa081c2960243" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:47.241277 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f65f428a604ab4b8baa081c2960243" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:47.241401 10982 raft_consensus.cc:3060] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.241401 11272 raft_consensus.cc:3060] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.242331 11272 raft_consensus.cc:2468] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:47.242331 10982 raft_consensus.cc:2468] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:47.242790 11065 leader_election.cc:304] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:47.243088 11503 raft_consensus.cc:2804] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:47.243180 11503 raft_consensus.cc:697] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:47.243399 11503 consensus_queue.cc:237] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.322201 11562 consensus_queue.cc:1048] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.338042 11503 consensus_queue.cc:1048] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.346477 10797 catalog_manager.cc:3502] renamed table default.table_ebde49fe473f4e73a80a82acbd08c0c9 [id=7b1dce0350184df085c1148baa6c931b] in HMS: new name default.table_0d8473dff6e244c199473f589d46be1b
I20260502 20:00:47.377797 11521 consensus_queue.cc:1048] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.385299 11504 consensus_queue.cc:1048] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.402675 11536 consensus_queue.cc:1048] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.408504 11524 consensus_queue.cc:1048] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.441221 10798 catalog_manager.cc:3502] renamed table default.table_80d254b59aeb4715a2c7c15eaa36d97d [id=128b3728f94e46d1b4450c586944e3dc] in HMS: new name default.table_35a03681af3042babb0e601163d9fe20
I20260502 20:00:47.506707 10801 catalog_manager.cc:3502] renamed table default.table_92210f99df6644f08ec2076ab59d9a8e [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f] in HMS: new name default.table_ac5362bfe46a4090a35bd51ad90c59ad
I20260502 20:00:47.531981 10350 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu with pid 10701
I20260502 20:00:47.580313 10806 catalog_manager.cc:3502] renamed table default.table_ca365f139e204571a925ae336a6fd2fd [id=4ce433e96065488abd346ff7bb660464] in HMS: new name default.table_d4efc4ecb8b04c828595edb245352971
I20260502 20:00:47.580813 11590 raft_consensus.cc:493] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:00:47.580999 11590 raft_consensus.cc:515] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:47.583413 10816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38315e4f56484666b5e54afad02498ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 39 } } ignore_live_leader: false dest_uuid: "b470a66ad54f46b1b44a80dd1edf214e" is_pre_election: true
I20260502 20:00:47.586325 11590 leader_election.cc:290] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:00:47.586863 11397 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:00:47.587909 11397 leader_election.cc:336] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:00:47.587986 11397 leader_election.cc:304] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38315e4f56484666b5e54afad02498ec; no voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4
I20260502 20:00:47.588374 11590 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260502 20:00:47.617839 10799 catalog_manager.cc:2174] created HMS catalog entry for table [id=e0c3a8a8b06e4796b9830f73219a09c2]
W20260502 20:00:47.626717 10790 consensus_peers.cc:597] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e -> Peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Couldn't send request to peer ef9294b460014382a2a594c77f8900d4. Status: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260502 20:00:47.628501 10799 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 40) took 1678 ms. Trace:
I20260502 20:00:47.628576 10799 rpcz_store.cc:276] 0502 20:00:45.950110 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:46.156132 (+206022us) service_pool.cc:224] Handling call
0502 20:00:47.057598 (+901466us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:47.057959 (+ 361us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:47.617825 (+559866us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:47.628307 (+ 10482us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:47.628407 (+ 100us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:47.628487 (+ 80us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:47.622049 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:47.622193 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:47.622198 (+ 5us) write_op.cc:435] Acquired schema lock
0502 20:00:47.622200 (+ 2us) tablet.cc:662] Decoding operations
0502 20:00:47.622282 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:47.622294 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:47.622298 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:47.622365 (+ 67us) tablet.cc:701] Row locks acquired
0502 20:00:47.622367 (+ 2us) write_op.cc:260] PREPARE: finished
0502 20:00:47.622403 (+ 36us) write_op.cc:270] Start()
0502 20:00:47.622434 (+ 31us) write_op.cc:276] Timestamp: P: 1777752047622324 usec, L: 0
0502 20:00:47.622437 (+ 3us) op_driver.cc:348] REPLICATION: starting
0502 20:00:47.622619 (+ 182us) log.cc:844] Serialized 432 byte log entry
0502 20:00:47.627661 (+ 5042us) op_driver.cc:464] REPLICATION: finished
0502 20:00:47.627954 (+ 293us) write_op.cc:301] APPLY: starting
0502 20:00:47.627969 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:47.627995 (+ 26us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:47.628006 (+ 11us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:47.628067 (+ 61us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:47.628089 (+ 22us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:47.628093 (+ 4us) write_op.cc:312] APPLY: finished
0502 20:00:47.628142 (+ 49us) log.cc:844] Serialized 28 byte log entry
0502 20:00:47.628222 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:47.628235 (+ 13us) write_op.cc:454] Released schema lock
0502 20:00:47.628240 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":522133,"Hive Metastore.run_cpu_time_us":245,"Hive Metastore.run_wall_time_us":37405,"child_traces":[["op",{"apply.queue_time_us":235,"num_ops":2,"prepare.queue_time_us":3610,"prepare.run_cpu_time_us":834,"prepare.run_wall_time_us":836,"raft.queue_time_us":4204,"raft.run_cpu_time_us":538,"raft.run_wall_time_us":1047,"replication_time_us":5193,"thread_start_us":364,"threads_started":4}]]}
I20260502 20:00:47.636833 10976 tablet_service.cc:1511] Processing CreateTablet for tablet e43e158d448442d3811dbdfe82db47ca (DEFAULT_TABLE table=default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.637174 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e43e158d448442d3811dbdfe82db47ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.638278 11112 tablet_service.cc:1511] Processing CreateTablet for tablet e43e158d448442d3811dbdfe82db47ca (DEFAULT_TABLE table=default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.638597 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e43e158d448442d3811dbdfe82db47ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.640004 11602 tablet_bootstrap.cc:492] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:47.641027 11253 tablet_service.cc:1511] Processing CreateTablet for tablet e43e158d448442d3811dbdfe82db47ca (DEFAULT_TABLE table=default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.641278 11602 tablet_bootstrap.cc:654] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.641332 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e43e158d448442d3811dbdfe82db47ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.641979 11603 tablet_bootstrap.cc:492] T e43e158d448442d3811dbdfe82db47ca P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:47.643985 11603 tablet_bootstrap.cc:654] T e43e158d448442d3811dbdfe82db47ca P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.644922 11503 consensus_queue.cc:1048] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.645200 11602 tablet_bootstrap.cc:492] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:47.645303 11602 ts_tablet_manager.cc:1403] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260502 20:00:47.645774 11602 raft_consensus.cc:359] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.645905 11602 raft_consensus.cc:385] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.645954 11602 raft_consensus.cc:740] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.646116 11602 consensus_queue.cc:260] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.646505 11602 ts_tablet_manager.cc:1434] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:47.647541 10799 catalog_manager.cc:5671] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to 858db0bc9f07476e9d1540f2b095414f (127.10.27.129). New cstate: current_term: 1 leader_uuid: "858db0bc9f07476e9d1540f2b095414f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:47.648092 11603 tablet_bootstrap.cc:492] T e43e158d448442d3811dbdfe82db47ca P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:47.648185 11603 ts_tablet_manager.cc:1403] T e43e158d448442d3811dbdfe82db47ca P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260502 20:00:47.648664 11603 raft_consensus.cc:359] T e43e158d448442d3811dbdfe82db47ca P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.648864 11603 raft_consensus.cc:385] T e43e158d448442d3811dbdfe82db47ca P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.648896 11603 raft_consensus.cc:740] T e43e158d448442d3811dbdfe82db47ca P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.650596 11603 consensus_queue.cc:260] T e43e158d448442d3811dbdfe82db47ca P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.654706 11603 ts_tablet_manager.cc:1434] T e43e158d448442d3811dbdfe82db47ca P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260502 20:00:47.654649 11562 consensus_queue.cc:1048] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.655751 11605 tablet_bootstrap.cc:492] T e43e158d448442d3811dbdfe82db47ca P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:47.656055 11503 consensus_queue.cc:1048] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.657176 11605 tablet_bootstrap.cc:654] T e43e158d448442d3811dbdfe82db47ca P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.660835 10799 catalog_manager.cc:5671] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130). New cstate: current_term: 1 leader_uuid: "b85d150f168f406bb31ff44150b2b1a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:47.663139 11605 tablet_bootstrap.cc:492] T e43e158d448442d3811dbdfe82db47ca P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:47.663251 11605 ts_tablet_manager.cc:1403] T e43e158d448442d3811dbdfe82db47ca P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260502 20:00:47.663793 11605 raft_consensus.cc:359] T e43e158d448442d3811dbdfe82db47ca P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.663903 11605 raft_consensus.cc:385] T e43e158d448442d3811dbdfe82db47ca P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.663938 11605 raft_consensus.cc:740] T e43e158d448442d3811dbdfe82db47ca P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.664093 11605 consensus_queue.cc:260] T e43e158d448442d3811dbdfe82db47ca P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.668831 10799 catalog_manager.cc:5671] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130). New cstate: current_term: 1 leader_uuid: "b85d150f168f406bb31ff44150b2b1a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } }
I20260502 20:00:47.672181 11612 consensus_queue.cc:1048] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.675473 11605 ts_tablet_manager.cc:1434] T e43e158d448442d3811dbdfe82db47ca P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.012s user 0.000s sys 0.001s
I20260502 20:00:47.675971 10802 catalog_manager.cc:2174] created HMS catalog entry for table [id=536908a003d34b1997dce28d2c91327b]
I20260502 20:00:47.681572 10802 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 41) took 1652 ms. Trace:
I20260502 20:00:47.681665 10802 rpcz_store.cc:276] 0502 20:00:46.028677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:46.326071 (+297394us) service_pool.cc:224] Handling call
0502 20:00:47.058370 (+732299us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:47.058668 (+ 298us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:47.675962 (+617294us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:47.681231 (+ 5269us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:47.681463 (+ 232us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:47.681551 (+ 88us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:47.676801 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:47.676885 (+ 84us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:47.676889 (+ 4us) write_op.cc:435] Acquired schema lock
0502 20:00:47.676890 (+ 1us) tablet.cc:662] Decoding operations
0502 20:00:47.676947 (+ 57us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:47.676954 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:47.676957 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:47.677004 (+ 47us) tablet.cc:701] Row locks acquired
0502 20:00:47.677005 (+ 1us) write_op.cc:260] PREPARE: finished
0502 20:00:47.677032 (+ 27us) write_op.cc:270] Start()
0502 20:00:47.677059 (+ 27us) write_op.cc:276] Timestamp: P: 1777752047676951 usec, L: 0
0502 20:00:47.677061 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 20:00:47.677185 (+ 124us) log.cc:844] Serialized 432 byte log entry
0502 20:00:47.679684 (+ 2499us) op_driver.cc:464] REPLICATION: finished
0502 20:00:47.680927 (+ 1243us) write_op.cc:301] APPLY: starting
0502 20:00:47.680939 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:47.680963 (+ 24us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:47.680974 (+ 11us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:47.681033 (+ 59us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:47.681057 (+ 24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:47.681061 (+ 4us) write_op.cc:312] APPLY: finished
0502 20:00:47.681108 (+ 47us) log.cc:844] Serialized 28 byte log entry
0502 20:00:47.681147 (+ 39us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:47.681158 (+ 11us) write_op.cc:454] Released schema lock
0502 20:00:47.681162 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0502 20:00:47.681222 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:47.681224 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":558904,"Hive Metastore.run_cpu_time_us":213,"Hive Metastore.run_wall_time_us":58108,"child_traces":[["op",{"apply.queue_time_us":1193,"apply.run_cpu_time_us":290,"apply.run_wall_time_us":289,"num_ops":2,"prepare.queue_time_us":408,"prepare.run_cpu_time_us":461,"prepare.run_wall_time_us":460,"raft.queue_time_us":78,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":2603}]]}
I20260502 20:00:47.686303 11112 tablet_service.cc:1511] Processing CreateTablet for tablet 71894a5bf3214ed3a2329f1a2a134b19 (DEFAULT_TABLE table=default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.686506 11253 tablet_service.cc:1511] Processing CreateTablet for tablet 71894a5bf3214ed3a2329f1a2a134b19 (DEFAULT_TABLE table=default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.686659 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71894a5bf3214ed3a2329f1a2a134b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.686784 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71894a5bf3214ed3a2329f1a2a134b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.689258 11603 tablet_bootstrap.cc:492] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:47.689325 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 71894a5bf3214ed3a2329f1a2a134b19 (DEFAULT_TABLE table=default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.689623 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71894a5bf3214ed3a2329f1a2a134b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.690380 11603 tablet_bootstrap.cc:654] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.692011 11602 tablet_bootstrap.cc:492] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:47.693109 11602 tablet_bootstrap.cc:654] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.693755 10799 catalog_manager.cc:5671] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130). New cstate: current_term: 1 leader_uuid: "b85d150f168f406bb31ff44150b2b1a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:47.694161 11605 tablet_bootstrap.cc:492] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:47.695127 11603 tablet_bootstrap.cc:492] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:47.695238 11603 ts_tablet_manager.cc:1403] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260502 20:00:47.695742 11603 raft_consensus.cc:359] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.695859 11603 raft_consensus.cc:385] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.695901 11603 raft_consensus.cc:740] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.696022 11603 consensus_queue.cc:260] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.696359 11603 ts_tablet_manager.cc:1434] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:47.702364 11602 tablet_bootstrap.cc:492] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:47.702610 11602 ts_tablet_manager.cc:1403] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260502 20:00:47.703637 11602 raft_consensus.cc:359] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.703778 11602 raft_consensus.cc:385] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.703824 11602 raft_consensus.cc:740] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.703951 11602 consensus_queue.cc:260] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.704308 11602 ts_tablet_manager.cc:1434] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260502 20:00:47.706390 10802 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_11635cffa19740e19919a56d36ca0879" } modify_external_catalogs: true
I20260502 20:00:47.706544 10802 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_11635cffa19740e19919a56d36ca0879" } modify_external_catalogs: true
I20260502 20:00:47.707401 10799 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_69320349621b4b9399e4602c5d03321a" } modify_external_catalogs: true
I20260502 20:00:47.707509 10799 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_69320349621b4b9399e4602c5d03321a" } modify_external_catalogs: true
I20260502 20:00:47.708155 11605 tablet_bootstrap.cc:654] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.709457 11605 tablet_bootstrap.cc:492] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:47.709563 11605 ts_tablet_manager.cc:1403] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20260502 20:00:47.710078 11605 raft_consensus.cc:359] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.710196 11605 raft_consensus.cc:385] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.710233 11605 raft_consensus.cc:740] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.710392 11605 consensus_queue.cc:260] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.710685 11605 ts_tablet_manager.cc:1434] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:00:47.731006 11505 consensus_queue.cc:1048] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.738363 10805 catalog_manager.cc:2174] created HMS catalog entry for table [id=69692b57e81f408db409df6a8991a064]
I20260502 20:00:47.745244 11524 consensus_queue.cc:1048] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.748358 10805 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 43) took 1608 ms. Trace:
I20260502 20:00:47.748466 10805 rpcz_store.cc:276] 0502 20:00:46.139766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:46.826266 (+686500us) service_pool.cc:224] Handling call
0502 20:00:47.059025 (+232759us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:47.059316 (+ 291us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:47.738350 (+679034us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:47.748104 (+ 9754us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:47.748202 (+ 98us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:47.748327 (+ 125us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:47.739018 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:47.739139 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:47.739144 (+ 5us) write_op.cc:435] Acquired schema lock
0502 20:00:47.739145 (+ 1us) tablet.cc:662] Decoding operations
0502 20:00:47.739216 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:47.739226 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:47.739229 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:47.739287 (+ 58us) tablet.cc:701] Row locks acquired
0502 20:00:47.739289 (+ 2us) write_op.cc:260] PREPARE: finished
0502 20:00:47.739323 (+ 34us) write_op.cc:270] Start()
0502 20:00:47.739351 (+ 28us) write_op.cc:276] Timestamp: P: 1777752047739235 usec, L: 0
0502 20:00:47.739353 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 20:00:47.739496 (+ 143us) log.cc:844] Serialized 432 byte log entry
0502 20:00:47.744016 (+ 4520us) op_driver.cc:464] REPLICATION: finished
0502 20:00:47.744147 (+ 131us) write_op.cc:301] APPLY: starting
0502 20:00:47.744164 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:47.744196 (+ 32us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:47.744210 (+ 14us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:47.744289 (+ 79us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:47.744422 (+ 133us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:47.744427 (+ 5us) write_op.cc:312] APPLY: finished
0502 20:00:47.744501 (+ 74us) log.cc:844] Serialized 28 byte log entry
0502 20:00:47.744560 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:47.744576 (+ 16us) write_op.cc:454] Released schema lock
0502 20:00:47.744582 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0502 20:00:47.744643 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:47.744645 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":616402,"Hive Metastore.run_cpu_time_us":208,"Hive Metastore.run_wall_time_us":57056,"child_traces":[["op",{"apply.queue_time_us":89,"apply.run_cpu_time_us":485,"apply.run_wall_time_us":484,"num_ops":2,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":576,"prepare.run_wall_time_us":577,"raft.queue_time_us":684,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":197,"replication_time_us":4634}]]}
I20260502 20:00:47.761685 11112 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5e048f6c304494a4aa8d0d75913b74 (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.762020 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5e048f6c304494a4aa8d0d75913b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.762128 11253 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5e048f6c304494a4aa8d0d75913b74 (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.762426 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5e048f6c304494a4aa8d0d75913b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.763661 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5e048f6c304494a4aa8d0d75913b74 (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.763945 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5e048f6c304494a4aa8d0d75913b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.764870 11603 tablet_bootstrap.cc:492] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:47.765946 11603 tablet_bootstrap.cc:654] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.766175 11602 tablet_bootstrap.cc:492] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:47.767328 11602 tablet_bootstrap.cc:654] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.769984 11605 tablet_bootstrap.cc:492] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:47.770587 11603 tablet_bootstrap.cc:492] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:47.770720 11603 ts_tablet_manager.cc:1403] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20260502 20:00:47.771185 11605 tablet_bootstrap.cc:654] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.771281 11603 raft_consensus.cc:359] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.771420 11603 raft_consensus.cc:385] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.771456 11603 raft_consensus.cc:740] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.771607 11603 consensus_queue.cc:260] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.773208 11603 ts_tablet_manager.cc:1434] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 20:00:47.779068 10805 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_a6206a3729bf45dd8fcbcd4401f97845" } modify_external_catalogs: true
I20260502 20:00:47.779269 10805 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_a6206a3729bf45dd8fcbcd4401f97845" } modify_external_catalogs: true
I20260502 20:00:47.780602 11602 tablet_bootstrap.cc:492] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:47.780699 11602 ts_tablet_manager.cc:1403] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260502 20:00:47.781188 11602 raft_consensus.cc:359] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.781288 11602 raft_consensus.cc:385] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.781327 11602 raft_consensus.cc:740] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.781441 11602 consensus_queue.cc:260] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.781703 11602 ts_tablet_manager.cc:1434] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:47.785162 10804 catalog_manager.cc:2174] created HMS catalog entry for table [id=f0219fbc9a284d7db713f900ab2f2c63]
I20260502 20:00:47.785462 11605 tablet_bootstrap.cc:492] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:47.785562 11605 ts_tablet_manager.cc:1403] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.001s
I20260502 20:00:47.786063 11605 raft_consensus.cc:359] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.786183 11605 raft_consensus.cc:385] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.786216 11605 raft_consensus.cc:740] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.786352 11605 consensus_queue.cc:260] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.786623 11605 ts_tablet_manager.cc:1434] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260502 20:00:47.791465 10804 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 50) took 1458 ms. Trace:
I20260502 20:00:47.791554 10804 rpcz_store.cc:276] 0502 20:00:46.332746 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:46.973119 (+640373us) service_pool.cc:224] Handling call
0502 20:00:47.059649 (+ 86530us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:47.059935 (+ 286us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:47.785152 (+725217us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:47.791250 (+ 6098us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:47.791366 (+ 116us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:47.791447 (+ 81us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:47.785683 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:47.785787 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:47.785791 (+ 4us) write_op.cc:435] Acquired schema lock
0502 20:00:47.785793 (+ 2us) tablet.cc:662] Decoding operations
0502 20:00:47.785855 (+ 62us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:47.785865 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:47.785868 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:47.785920 (+ 52us) tablet.cc:701] Row locks acquired
0502 20:00:47.785922 (+ 2us) write_op.cc:260] PREPARE: finished
0502 20:00:47.785949 (+ 27us) write_op.cc:270] Start()
0502 20:00:47.785975 (+ 26us) write_op.cc:276] Timestamp: P: 1777752047785861 usec, L: 0
0502 20:00:47.785977 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 20:00:47.786102 (+ 125us) log.cc:844] Serialized 432 byte log entry
0502 20:00:47.790452 (+ 4350us) op_driver.cc:464] REPLICATION: finished
0502 20:00:47.790579 (+ 127us) write_op.cc:301] APPLY: starting
0502 20:00:47.790595 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:47.790629 (+ 34us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:47.790644 (+ 15us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:47.790722 (+ 78us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:47.790751 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:47.790755 (+ 4us) write_op.cc:312] APPLY: finished
0502 20:00:47.790817 (+ 62us) log.cc:844] Serialized 28 byte log entry
0502 20:00:47.790864 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:47.790878 (+ 14us) write_op.cc:454] Released schema lock
0502 20:00:47.790884 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0502 20:00:47.790991 (+ 107us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:47.790994 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":672877,"Hive Metastore.run_cpu_time_us":201,"Hive Metastore.run_wall_time_us":52205,"child_traces":[["op",{"apply.queue_time_us":84,"apply.run_cpu_time_us":403,"apply.run_wall_time_us":403,"num_ops":2,"prepare.queue_time_us":90,"prepare.run_cpu_time_us":503,"prepare.run_wall_time_us":498,"raft.queue_time_us":603,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":166,"replication_time_us":4447}]]}
I20260502 20:00:47.801463 10804 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_b451db44fa8e4d43a95881c29b8c60da" } modify_external_catalogs: true
I20260502 20:00:47.801620 10804 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_b451db44fa8e4d43a95881c29b8c60da" } modify_external_catalogs: true
I20260502 20:00:47.802224 11112 tablet_service.cc:1511] Processing CreateTablet for tablet 11548942c58f4c05bad32038a55b8f66 (DEFAULT_TABLE table=default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.802536 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11548942c58f4c05bad32038a55b8f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.802901 11253 tablet_service.cc:1511] Processing CreateTablet for tablet 11548942c58f4c05bad32038a55b8f66 (DEFAULT_TABLE table=default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.803234 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11548942c58f4c05bad32038a55b8f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.805546 11603 tablet_bootstrap.cc:492] T 11548942c58f4c05bad32038a55b8f66 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:47.806977 11603 tablet_bootstrap.cc:654] T 11548942c58f4c05bad32038a55b8f66 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.807801 11605 tablet_bootstrap.cc:492] T 11548942c58f4c05bad32038a55b8f66 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:47.808916 11605 tablet_bootstrap.cc:654] T 11548942c58f4c05bad32038a55b8f66 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.811054 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 11548942c58f4c05bad32038a55b8f66 (DEFAULT_TABLE table=default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.811378 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11548942c58f4c05bad32038a55b8f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.813546 11603 tablet_bootstrap.cc:492] T 11548942c58f4c05bad32038a55b8f66 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:47.813647 11603 ts_tablet_manager.cc:1403] T 11548942c58f4c05bad32038a55b8f66 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260502 20:00:47.813817 11602 tablet_bootstrap.cc:492] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:47.814211 11603 raft_consensus.cc:359] T 11548942c58f4c05bad32038a55b8f66 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.814324 11603 raft_consensus.cc:385] T 11548942c58f4c05bad32038a55b8f66 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.814353 11603 raft_consensus.cc:740] T 11548942c58f4c05bad32038a55b8f66 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.814477 11603 consensus_queue.cc:260] T 11548942c58f4c05bad32038a55b8f66 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.814734 11603 ts_tablet_manager.cc:1434] T 11548942c58f4c05bad32038a55b8f66 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:00:47.814877 11602 tablet_bootstrap.cc:654] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:47.816007 11605 tablet_bootstrap.cc:492] T 11548942c58f4c05bad32038a55b8f66 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:47.816102 11605 ts_tablet_manager.cc:1403] T 11548942c58f4c05bad32038a55b8f66 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260502 20:00:47.816656 11605 raft_consensus.cc:359] T 11548942c58f4c05bad32038a55b8f66 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.816781 11605 raft_consensus.cc:385] T 11548942c58f4c05bad32038a55b8f66 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.816814 11605 raft_consensus.cc:740] T 11548942c58f4c05bad32038a55b8f66 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.816975 11605 consensus_queue.cc:260] T 11548942c58f4c05bad32038a55b8f66 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.817989 11605 ts_tablet_manager.cc:1434] T 11548942c58f4c05bad32038a55b8f66 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260502 20:00:47.823632 11602 tablet_bootstrap.cc:492] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:47.823738 11602 ts_tablet_manager.cc:1403] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260502 20:00:47.824216 11602 raft_consensus.cc:359] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.824326 11602 raft_consensus.cc:385] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:47.824354 11602 raft_consensus.cc:740] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:47.824468 11602 consensus_queue.cc:260] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.824710 11602 ts_tablet_manager.cc:1434] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:47.829887 11503 consensus_queue.cc:1048] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.830536 11524 raft_consensus.cc:493] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:47.830653 11524 raft_consensus.cc:515] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.831097 11524 leader_election.cc:290] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:47.831676 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43e158d448442d3811dbdfe82db47ca" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:47.831826 11131 raft_consensus.cc:2468] T e43e158d448442d3811dbdfe82db47ca P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:47.831993 11503 consensus_queue.cc:1048] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:47.832168 10933 leader_election.cc:304] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:47.832871 11524 raft_consensus.cc:2804] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:47.832886 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43e158d448442d3811dbdfe82db47ca" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:47.832952 11524 raft_consensus.cc:493] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:47.833015 11524 raft_consensus.cc:3060] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.833015 11273 raft_consensus.cc:2468] T e43e158d448442d3811dbdfe82db47ca P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:47.834204 11524 raft_consensus.cc:515] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.834625 11524 leader_election.cc:290] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:47.835300 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43e158d448442d3811dbdfe82db47ca" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:47.835440 11131 raft_consensus.cc:3060] T e43e158d448442d3811dbdfe82db47ca P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.836558 11131 raft_consensus.cc:2468] T e43e158d448442d3811dbdfe82db47ca P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:47.837037 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e43e158d448442d3811dbdfe82db47ca" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:47.837177 11273 raft_consensus.cc:3060] T e43e158d448442d3811dbdfe82db47ca P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.838318 11273 raft_consensus.cc:2468] T e43e158d448442d3811dbdfe82db47ca P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:47.838747 10933 leader_election.cc:304] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:47.838994 11524 raft_consensus.cc:2804] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:47.839102 11524 raft_consensus.cc:697] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:47.839270 11524 consensus_queue.cc:237] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.879601 10800 catalog_manager.cc:3502] renamed table default.table_374d681ae8634e8a85619deb2997bb74 [id=7f99eb7719134a54a8f42be5b8c48760] in HMS: new name default.table_115178421c134252971c7a71b1134464
I20260502 20:00:47.879920 11611 raft_consensus.cc:493] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:47.880107 11611 raft_consensus.cc:515] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.880579 11611 leader_election.cc:290] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:47.881135 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5e048f6c304494a4aa8d0d75913b74" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:47.881237 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5e048f6c304494a4aa8d0d75913b74" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:47.881291 10995 raft_consensus.cc:2468] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:47.881381 11272 raft_consensus.cc:2468] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:47.881814 11065 leader_election.cc:304] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:47.882133 11611 raft_consensus.cc:2804] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:47.882229 11611 raft_consensus.cc:493] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:47.882284 11611 raft_consensus.cc:3060] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.883376 11611 raft_consensus.cc:515] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.883767 11611 leader_election.cc:290] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:47.884640 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5e048f6c304494a4aa8d0d75913b74" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:47.884784 10995 raft_consensus.cc:3060] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.885879 10995 raft_consensus.cc:2468] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:47.886207 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5e048f6c304494a4aa8d0d75913b74" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:47.886346 11272 raft_consensus.cc:3060] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.887321 11272 raft_consensus.cc:2468] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:47.887750 11065 leader_election.cc:304] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:47.888094 11611 raft_consensus.cc:2804] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:47.888185 11611 raft_consensus.cc:697] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:47.888319 11611 consensus_queue.cc:237] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:47.896188 11524 raft_consensus.cc:493] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:47.896308 11524 raft_consensus.cc:515] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.896683 11524 leader_election.cc:290] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:47.898773 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11548942c58f4c05bad32038a55b8f66" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:47.898916 11272 raft_consensus.cc:2468] T 11548942c58f4c05bad32038a55b8f66 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:47.899060 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11548942c58f4c05bad32038a55b8f66" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:47.899194 11131 raft_consensus.cc:2468] T 11548942c58f4c05bad32038a55b8f66 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:47.899317 10930 leader_election.cc:304] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:47.899814 11636 tablet.cc:1724] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.900246 11524 raft_consensus.cc:2804] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:47.900315 11524 raft_consensus.cc:493] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:47.900353 11524 raft_consensus.cc:3060] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.901403 11524 raft_consensus.cc:515] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.901790 11524 leader_election.cc:290] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:47.902215 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11548942c58f4c05bad32038a55b8f66" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:47.902354 11272 raft_consensus.cc:3060] T 11548942c58f4c05bad32038a55b8f66 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.903256 11272 raft_consensus.cc:2468] T 11548942c58f4c05bad32038a55b8f66 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:47.903609 10930 leader_election.cc:304] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:47.903821 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11548942c58f4c05bad32038a55b8f66" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:47.903926 11132 raft_consensus.cc:3060] T 11548942c58f4c05bad32038a55b8f66 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:47.904881 11132 raft_consensus.cc:2468] T 11548942c58f4c05bad32038a55b8f66 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:47.905391 11524 raft_consensus.cc:2804] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:47.905483 11524 raft_consensus.cc:697] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:47.905614 11524 consensus_queue.cc:237] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:47.905665 11635 tablet.cc:1724] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.912554 11639 tablet.cc:1724] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.913169 11635 tablet.cc:1724] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.916729 11637 tablet.cc:1724] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.922642 11639 tablet.cc:1724] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.923202 11636 tablet.cc:1724] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.923360 11635 tablet.cc:1724] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.927551 11635 tablet.cc:1724] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.930691 11636 tablet.cc:1724] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.931711 11644 tablet.cc:1724] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260502 20:00:47.935874 10803 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e3ad181715724e36aa7276f9790d41bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260502 20:00:47.939260 11639 tablet.cc:1724] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.940197 11635 tablet.cc:1724] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.940573 11637 tablet.cc:1724] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.964537 11644 tablet.cc:1724] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:47.971984 10803 catalog_manager.cc:2174] created HMS catalog entry for table [id=f769e13a80464a7983ad676c469e2e86]
I20260502 20:00:47.974717 10797 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:56168 (request call id 32) took 2227 ms. Trace:
I20260502 20:00:47.974799 10797 rpcz_store.cc:276] 0502 20:00:45.746849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:45.751694 (+ 4845us) service_pool.cc:224] Handling call
0502 20:00:47.056840 (+1305146us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:47.974209 (+917369us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:47.974485 (+ 276us) catalog_manager.cc:3725] Apply alter schema
0502 20:00:47.974698 (+ 213us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":3196,"Hive Metastore.run_cpu_time_us":921,"Hive Metastore.run_wall_time_us":286108}
I20260502 20:00:47.977110 10803 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 51) took 1454 ms. Trace:
I20260502 20:00:47.977183 10803 rpcz_store.cc:276] 0502 20:00:46.522273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:47.081406 (+559133us) service_pool.cc:224] Handling call
0502 20:00:47.935989 (+854583us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:47.936386 (+ 397us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:47.971972 (+ 35586us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:47.976918 (+ 4946us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 20:00:47.976997 (+ 79us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 20:00:47.977093 (+ 96us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:47.972649 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 20:00:47.972764 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0502 20:00:47.972768 (+ 4us) write_op.cc:435] Acquired schema lock
0502 20:00:47.972770 (+ 2us) tablet.cc:662] Decoding operations
0502 20:00:47.972843 (+ 73us) write_op.cc:620] Acquiring the partition lock for write op
0502 20:00:47.972853 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0502 20:00:47.972856 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0502 20:00:47.972914 (+ 58us) tablet.cc:701] Row locks acquired
0502 20:00:47.972915 (+ 1us) write_op.cc:260] PREPARE: finished
0502 20:00:47.972948 (+ 33us) write_op.cc:270] Start()
0502 20:00:47.972976 (+ 28us) write_op.cc:276] Timestamp: P: 1777752047972845 usec, L: 0
0502 20:00:47.972978 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 20:00:47.973145 (+ 167us) log.cc:844] Serialized 432 byte log entry
0502 20:00:47.976008 (+ 2863us) op_driver.cc:464] REPLICATION: finished
0502 20:00:47.976120 (+ 112us) write_op.cc:301] APPLY: starting
0502 20:00:47.976134 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0502 20:00:47.976163 (+ 29us) tablet.cc:1370] finished BulkCheckPresence
0502 20:00:47.976176 (+ 13us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 20:00:47.976255 (+ 79us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 20:00:47.976281 (+ 26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 20:00:47.976285 (+ 4us) write_op.cc:312] APPLY: finished
0502 20:00:47.976344 (+ 59us) log.cc:844] Serialized 28 byte log entry
0502 20:00:47.976389 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:47.976401 (+ 12us) write_op.cc:454] Released schema lock
0502 20:00:47.976405 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0502 20:00:47.976464 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:47.976469 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":5102,"Hive Metastore.run_cpu_time_us":250,"Hive Metastore.run_wall_time_us":30195,"child_traces":[["op",{"apply.queue_time_us":76,"apply.run_cpu_time_us":333,"apply.run_wall_time_us":332,"num_ops":2,"prepare.queue_time_us":102,"prepare.run_cpu_time_us":582,"prepare.run_wall_time_us":582,"raft.queue_time_us":973,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":205,"replication_time_us":3005}]]}
I20260502 20:00:47.977586 10803 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_7ce0c3c1163d4f549db7f3204c01f5ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:47.977710 10798 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:56168 (request call id 49) took 1656 ms. Trace:
I20260502 20:00:47.977769 10798 rpcz_store.cc:276] 0502 20:00:46.321646 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:46.933750 (+612104us) service_pool.cc:224] Handling call
0502 20:00:47.057063 (+123313us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:47.977359 (+920296us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:47.977524 (+ 165us) catalog_manager.cc:3725] Apply alter schema
0502 20:00:47.977695 (+ 171us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":289200,"Hive Metastore.run_cpu_time_us":550,"Hive Metastore.run_wall_time_us":94770}
I20260502 20:00:47.977960 10798 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_ae16bd7eeae84bcc9df91b677d29e577" } modify_external_catalogs: true
I20260502 20:00:47.978053 10798 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56168:
table { table_name: "default.Table_ae16bd7eeae84bcc9df91b677d29e577" } modify_external_catalogs: true
I20260502 20:00:47.978463 10801 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:56168 (request call id 42) took 1846 ms. Trace:
I20260502 20:00:47.978513 10801 rpcz_store.cc:276] 0502 20:00:46.131920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:46.818122 (+686202us) service_pool.cc:224] Handling call
0502 20:00:47.056840 (+238718us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:47.978148 (+921308us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:47.978292 (+ 144us) catalog_manager.cc:3725] Apply alter schema
0502 20:00:47.978450 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":384172,"Hive Metastore.run_cpu_time_us":582,"Hive Metastore.run_wall_time_us":65433,"mutex_wait_us":169}
I20260502 20:00:47.978717 10801 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_7d6b7fac1a1a41d680d0d2c5a9806f43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:47.979207 10806 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:56168 (request call id 39) took 2040 ms. Trace:
I20260502 20:00:47.979259 10806 rpcz_store.cc:276] 0502 20:00:45.938676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:45.949442 (+ 10766us) service_pool.cc:224] Handling call
0502 20:00:47.057129 (+1107687us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:47.978877 (+921748us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:47.979054 (+ 177us) catalog_manager.cc:3725] Apply alter schema
0502 20:00:47.979195 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":449469,"Hive Metastore.run_cpu_time_us":587,"Hive Metastore.run_wall_time_us":73444}
I20260502 20:00:47.979432 10806 master_service.cc:954] ReplaceTablet: received request to replace tablet 9402b710e18247e4abc7a69be19c4afe from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:47.980386 10800 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:56168 (request call id 38) took 2151 ms. Trace:
I20260502 20:00:47.980435 10800 rpcz_store.cc:276] 0502 20:00:45.828840 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:45.905128 (+ 76288us) service_pool.cc:224] Handling call
0502 20:00:47.057089 (+1151961us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:47.980093 (+923004us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:47.980232 (+ 139us) catalog_manager.cc:3725] Apply alter schema
0502 20:00:47.980374 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":723950,"Hive Metastore.run_cpu_time_us":494,"Hive Metastore.run_wall_time_us":94413,"mutex_wait_us":3940}
I20260502 20:00:47.980608 10800 master_service.cc:954] ReplaceTablet: received request to replace tablet 45f65f428a604ab4b8baa081c2960243 from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:47.983414 10797 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_972ed2d875504da381cc8d7d4a7630de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:47.991657 10800 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet 45f65f428a604ab4b8baa081c2960243
I20260502 20:00:47.992005 10800 catalog_manager.cc:6741] ReplaceTablet: tablet 45f65f428a604ab4b8baa081c2960243 deleted and replaced by tablet d2ae60584a4c449bb71ac28cb46c6f75
I20260502 20:00:47.993769 10806 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet 9402b710e18247e4abc7a69be19c4afe
I20260502 20:00:47.994068 10806 catalog_manager.cc:6741] ReplaceTablet: tablet 9402b710e18247e4abc7a69be19c4afe deleted and replaced by tablet 9bec1c114df8422099953a84b7ca0b19
I20260502 20:00:47.994540 10977 tablet_service.cc:1511] Processing CreateTablet for tablet be812b77483246f4bfa91d217b66de5b (DEFAULT_TABLE table=default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.994879 10977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be812b77483246f4bfa91d217b66de5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.995098 10976 tablet_service.cc:1558] Processing DeleteTablet for tablet 45f65f428a604ab4b8baa081c2960243 with delete_type TABLET_DATA_DELETED (replaced by tablet d2ae60584a4c449bb71ac28cb46c6f75) from {username='slave'} at 127.0.0.1:38494
I20260502 20:00:47.995424 11253 tablet_service.cc:1558] Processing DeleteTablet for tablet 45f65f428a604ab4b8baa081c2960243 with delete_type TABLET_DATA_DELETED (replaced by tablet d2ae60584a4c449bb71ac28cb46c6f75) from {username='slave'} at 127.0.0.1:54214
I20260502 20:00:47.995752 11112 tablet_service.cc:1558] Processing DeleteTablet for tablet 45f65f428a604ab4b8baa081c2960243 with delete_type TABLET_DATA_DELETED (replaced by tablet d2ae60584a4c449bb71ac28cb46c6f75) from {username='slave'} at 127.0.0.1:36722
I20260502 20:00:47.996202 11111 tablet_service.cc:1511] Processing CreateTablet for tablet be812b77483246f4bfa91d217b66de5b (DEFAULT_TABLE table=default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.996517 11111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be812b77483246f4bfa91d217b66de5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.997370 11252 tablet_service.cc:1511] Processing CreateTablet for tablet be812b77483246f4bfa91d217b66de5b (DEFAULT_TABLE table=default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:47.997614 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be812b77483246f4bfa91d217b66de5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:47.998775 11603 tablet_bootstrap.cc:492] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:47.999796 11602 tablet_bootstrap.cc:492] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:47.999846 11603 tablet_bootstrap.cc:654] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.000772 11602 tablet_bootstrap.cc:654] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.001434 11605 tablet_bootstrap.cc:492] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:48.002331 11605 tablet_bootstrap.cc:654] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.002563 11112 tablet_service.cc:1511] Processing CreateTablet for tablet d2ae60584a4c449bb71ac28cb46c6f75 (DEFAULT_TABLE table=default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:48.002826 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ae60584a4c449bb71ac28cb46c6f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:48.002907 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet 9402b710e18247e4abc7a69be19c4afe with delete_type TABLET_DATA_DELETED (replaced by tablet 9bec1c114df8422099953a84b7ca0b19) from {username='slave'} at 127.0.0.1:38494
I20260502 20:00:48.003521 11602 tablet_bootstrap.cc:492] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:48.003602 11602 ts_tablet_manager.cc:1403] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 20:00:48.003641 11253 tablet_service.cc:1511] Processing CreateTablet for tablet d2ae60584a4c449bb71ac28cb46c6f75 (DEFAULT_TABLE table=default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:48.003866 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ae60584a4c449bb71ac28cb46c6f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:48.004071 11602 raft_consensus.cc:359] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.004185 11602 raft_consensus.cc:385] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.004216 11602 raft_consensus.cc:740] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.004359 11602 consensus_queue.cc:260] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.004628 11602 ts_tablet_manager.cc:1434] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:48.006443 10977 tablet_service.cc:1511] Processing CreateTablet for tablet d2ae60584a4c449bb71ac28cb46c6f75 (DEFAULT_TABLE table=default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:48.006665 10977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ae60584a4c449bb71ac28cb46c6f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:48.008901 11602 tablet_bootstrap.cc:492] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:48.008936 11252 tablet_service.cc:1558] Processing DeleteTablet for tablet 9402b710e18247e4abc7a69be19c4afe with delete_type TABLET_DATA_DELETED (replaced by tablet 9bec1c114df8422099953a84b7ca0b19) from {username='slave'} at 127.0.0.1:54214
I20260502 20:00:48.009167 11111 tablet_service.cc:1558] Processing DeleteTablet for tablet 9402b710e18247e4abc7a69be19c4afe with delete_type TABLET_DATA_DELETED (replaced by tablet 9bec1c114df8422099953a84b7ca0b19) from {username='slave'} at 127.0.0.1:36722
I20260502 20:00:48.009917 11602 tablet_bootstrap.cc:654] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.011587 11605 tablet_bootstrap.cc:492] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:48.011675 11605 ts_tablet_manager.cc:1403] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20260502 20:00:48.012082 11651 tablet_replica.cc:333] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:48.012141 11605 raft_consensus.cc:359] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.012252 11605 raft_consensus.cc:385] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.012288 11605 raft_consensus.cc:740] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.012399 11605 consensus_queue.cc:260] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.012663 11605 ts_tablet_manager.cc:1434] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:00:48.012857 11605 tablet_bootstrap.cc:492] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:48.013043 11653 tablet_replica.cc:333] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:48.012876 11652 tablet_replica.cc:333] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:48.013702 11651 raft_consensus.cc:2243] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:48.014047 11652 raft_consensus.cc:2243] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:48.014312 11653 raft_consensus.cc:2243] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:48.014530 11651 raft_consensus.cc:2272] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:48.014487 10806 catalog_manager.cc:5671] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130). New cstate: current_term: 1 leader_uuid: "b85d150f168f406bb31ff44150b2b1a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:48.014706 11652 raft_consensus.cc:2272] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:48.015079 11252 tablet_service.cc:1511] Processing CreateTablet for tablet 9bec1c114df8422099953a84b7ca0b19 (DEFAULT_TABLE table=default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:48.015172 11653 raft_consensus.cc:2272] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:48.015321 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bec1c114df8422099953a84b7ca0b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:48.016088 11652 ts_tablet_manager.cc:1916] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:48.017295 11111 tablet_service.cc:1511] Processing CreateTablet for tablet 9bec1c114df8422099953a84b7ca0b19 (DEFAULT_TABLE table=default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:48.017594 11111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bec1c114df8422099953a84b7ca0b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:48.018242 10977 tablet_service.cc:1511] Processing CreateTablet for tablet 9bec1c114df8422099953a84b7ca0b19 (DEFAULT_TABLE table=default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:48.018500 10977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bec1c114df8422099953a84b7ca0b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:48.018651 11651 ts_tablet_manager.cc:1916] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:48.014117 11605 tablet_bootstrap.cc:654] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.021106 11651 ts_tablet_manager.cc:1929] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:48.021178 11651 log.cc:1199] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/45f65f428a604ab4b8baa081c2960243
I20260502 20:00:48.021481 11651 ts_tablet_manager.cc:1950] T 45f65f428a604ab4b8baa081c2960243 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:48.022627 11651 tablet_replica.cc:333] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:48.022784 10790 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet 45f65f428a604ab4b8baa081c2960243 (table default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]) successfully deleted
I20260502 20:00:48.022850 11651 raft_consensus.cc:2243] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:48.023123 11651 raft_consensus.cc:2272] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:48.023557 11605 tablet_bootstrap.cc:492] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:48.023650 11605 ts_tablet_manager.cc:1403] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.001s
I20260502 20:00:48.024158 11605 raft_consensus.cc:359] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.024308 11605 raft_consensus.cc:385] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.024354 11605 raft_consensus.cc:740] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.024405 10800 catalog_manager.cc:6216] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc] alter complete (version 1)
I20260502 20:00:48.024488 11605 consensus_queue.cc:260] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.024827 11605 ts_tablet_manager.cc:1434] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:00:48.025039 11605 tablet_bootstrap.cc:492] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:48.026124 11605 tablet_bootstrap.cc:654] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.030215 10806 catalog_manager.cc:6216] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b] alter complete (version 1)
I20260502 20:00:48.033176 10800 catalog_manager.cc:6216] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464] alter complete (version 1)
I20260502 20:00:48.035732 11603 tablet_bootstrap.cc:492] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:48.035856 11603 ts_tablet_manager.cc:1403] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.000s
I20260502 20:00:48.036396 11603 raft_consensus.cc:359] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.036518 11603 raft_consensus.cc:385] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.036551 11603 raft_consensus.cc:740] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.036681 11603 consensus_queue.cc:260] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.036749 11653 ts_tablet_manager.cc:1916] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:48.036965 11603 ts_tablet_manager.cc:1434] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:48.037186 11603 tablet_bootstrap.cc:492] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:48.037612 11652 ts_tablet_manager.cc:1929] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:48.037691 11652 log.cc:1199] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/45f65f428a604ab4b8baa081c2960243
I20260502 20:00:48.036266 11651 ts_tablet_manager.cc:1916] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:48.038003 11652 ts_tablet_manager.cc:1950] T 45f65f428a604ab4b8baa081c2960243 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:48.038259 11603 tablet_bootstrap.cc:654] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.038712 11652 tablet_replica.cc:333] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:48.038834 11652 raft_consensus.cc:2243] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:48.038894 10790 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet 45f65f428a604ab4b8baa081c2960243 (table default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]) successfully deleted
I20260502 20:00:48.038978 11652 raft_consensus.cc:2272] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:48.042759 11605 tablet_bootstrap.cc:492] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:48.042860 11605 ts_tablet_manager.cc:1403] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.001s
I20260502 20:00:48.043383 11605 raft_consensus.cc:359] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.043506 11605 raft_consensus.cc:385] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.043540 11605 raft_consensus.cc:740] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.043673 11605 consensus_queue.cc:260] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.043951 11605 ts_tablet_manager.cc:1434] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:48.043969 11652 ts_tablet_manager.cc:1916] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:48.044981 11651 ts_tablet_manager.cc:1929] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:48.045094 11651 log.cc:1199] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/9402b710e18247e4abc7a69be19c4afe
I20260502 20:00:48.045439 11603 tablet_bootstrap.cc:492] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:48.045532 11603 ts_tablet_manager.cc:1403] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260502 20:00:48.045948 11653 ts_tablet_manager.cc:1929] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:48.046008 11603 raft_consensus.cc:359] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.046121 11603 raft_consensus.cc:385] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.046151 11603 raft_consensus.cc:740] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.046182 11651 ts_tablet_manager.cc:1950] T 9402b710e18247e4abc7a69be19c4afe P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:48.046274 11603 consensus_queue.cc:260] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.046537 11603 ts_tablet_manager.cc:1434] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:48.046718 11603 tablet_bootstrap.cc:492] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:48.047426 10790 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet 9402b710e18247e4abc7a69be19c4afe (table default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]) successfully deleted
I20260502 20:00:48.048010 11602 tablet_bootstrap.cc:492] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:48.048120 11602 ts_tablet_manager.cc:1403] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.000s
I20260502 20:00:48.048565 11602 raft_consensus.cc:359] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.048671 11602 raft_consensus.cc:385] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.048699 11602 raft_consensus.cc:740] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.048808 11602 consensus_queue.cc:260] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.049106 11602 ts_tablet_manager.cc:1434] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:48.049288 11602 tablet_bootstrap.cc:492] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:48.049446 10806 catalog_manager.cc:6216] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f] alter complete (version 1)
I20260502 20:00:48.049572 10800 catalog_manager.cc:6216] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760] alter complete (version 1)
I20260502 20:00:48.050199 11602 tablet_bootstrap.cc:654] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.051425 11603 tablet_bootstrap.cc:654] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.051311 10800 catalog_manager.cc:5671] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to 858db0bc9f07476e9d1540f2b095414f (127.10.27.129). New cstate: current_term: 1 leader_uuid: "858db0bc9f07476e9d1540f2b095414f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:48.051628 10800 catalog_manager.cc:5671] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to 858db0bc9f07476e9d1540f2b095414f (127.10.27.129). New cstate: current_term: 1 leader_uuid: "858db0bc9f07476e9d1540f2b095414f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:48.046015 11653 log.cc:1199] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/45f65f428a604ab4b8baa081c2960243
I20260502 20:00:48.052551 11653 ts_tablet_manager.cc:1950] T 45f65f428a604ab4b8baa081c2960243 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:48.053237 11653 tablet_replica.cc:333] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:48.053364 11653 raft_consensus.cc:2243] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:48.053537 11653 raft_consensus.cc:2272] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:48.054111 11653 ts_tablet_manager.cc:1916] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:48.054029 10793 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet 45f65f428a604ab4b8baa081c2960243 (table default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]) successfully deleted
I20260502 20:00:48.054666 11652 ts_tablet_manager.cc:1929] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:48.054735 11652 log.cc:1199] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/9402b710e18247e4abc7a69be19c4afe
I20260502 20:00:48.055097 11652 ts_tablet_manager.cc:1950] T 9402b710e18247e4abc7a69be19c4afe P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:48.055874 10790 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet 9402b710e18247e4abc7a69be19c4afe (table default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]) successfully deleted
I20260502 20:00:48.056358 11653 ts_tablet_manager.cc:1929] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:48.056425 11653 log.cc:1199] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/9402b710e18247e4abc7a69be19c4afe
I20260502 20:00:48.056648 11653 ts_tablet_manager.cc:1950] T 9402b710e18247e4abc7a69be19c4afe P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:48.057314 10793 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet 9402b710e18247e4abc7a69be19c4afe (table default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]) successfully deleted
I20260502 20:00:48.058035 10806 master_service.cc:954] ReplaceTablet: received request to replace tablet f9c736521db340f8a196571bae1d1beb from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:48.058789 11562 raft_consensus.cc:493] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:48.058920 11602 tablet_bootstrap.cc:492] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:48.059031 11602 ts_tablet_manager.cc:1403] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260502 20:00:48.058874 11562 raft_consensus.cc:515] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:48.059497 11602 raft_consensus.cc:359] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.059589 11602 raft_consensus.cc:385] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.059616 11602 raft_consensus.cc:740] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.059639 11562 leader_election.cc:290] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:48.059746 11602 consensus_queue.cc:260] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.060019 11602 ts_tablet_manager.cc:1434] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:48.060632 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71894a5bf3214ed3a2329f1a2a134b19" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:48.060771 11272 raft_consensus.cc:2468] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:48.061018 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71894a5bf3214ed3a2329f1a2a134b19" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:48.061142 10995 raft_consensus.cc:2468] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:48.061440 11065 leader_election.cc:304] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:48.061625 11562 raft_consensus.cc:2804] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:48.061694 11562 raft_consensus.cc:493] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:48.061748 11562 raft_consensus.cc:3060] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.062834 11562 raft_consensus.cc:515] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:48.063253 11562 leader_election.cc:290] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:48.063895 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71894a5bf3214ed3a2329f1a2a134b19" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:48.064054 11272 raft_consensus.cc:3060] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.064253 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet 9402b710e18247e4abc7a69be19c4afe with delete_type TABLET_DATA_DELETED (replaced by tablet 9bec1c114df8422099953a84b7ca0b19) from {username='slave'} at 127.0.0.1:38494
W20260502 20:00:48.064941 10790 catalog_manager.cc:4969] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): delete failed for tablet 9402b710e18247e4abc7a69be19c4afe because the tablet was not found. No further retry: Not found: Tablet not found: 9402b710e18247e4abc7a69be19c4afe
I20260502 20:00:48.065096 11272 raft_consensus.cc:2468] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:48.065325 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71894a5bf3214ed3a2329f1a2a134b19" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:48.065403 11065 leader_election.cc:304] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:48.065436 10995 raft_consensus.cc:3060] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.066394 11562 raft_consensus.cc:2804] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:48.066401 10800 master_service.cc:954] ReplaceTablet: received request to replace tablet 7d82a249a8664df98444dbe25dd27cc4 from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:48.066437 10995 raft_consensus.cc:2468] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:48.066489 11562 raft_consensus.cc:697] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:48.066638 11562 consensus_queue.cc:237] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:48.067999 10806 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet f9c736521db340f8a196571bae1d1beb
I20260502 20:00:48.068302 10806 catalog_manager.cc:6741] ReplaceTablet: tablet f9c736521db340f8a196571bae1d1beb deleted and replaced by tablet 34eaaaf6417a4e80b3409ea1fdcac25b
I20260502 20:00:48.068418 10806 master_service.cc:954] ReplaceTablet: received request to replace tablet 9402b710e18247e4abc7a69be19c4afe from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:48.068524 11111 tablet_service.cc:1558] Processing DeleteTablet for tablet f9c736521db340f8a196571bae1d1beb with delete_type TABLET_DATA_DELETED (replaced by tablet 34eaaaf6417a4e80b3409ea1fdcac25b) from {username='slave'} at 127.0.0.1:36722
I20260502 20:00:48.068825 11252 tablet_service.cc:1558] Processing DeleteTablet for tablet f9c736521db340f8a196571bae1d1beb with delete_type TABLET_DATA_DELETED (replaced by tablet 34eaaaf6417a4e80b3409ea1fdcac25b) from {username='slave'} at 127.0.0.1:54214
I20260502 20:00:48.068940 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet f9c736521db340f8a196571bae1d1beb with delete_type TABLET_DATA_DELETED (replaced by tablet 34eaaaf6417a4e80b3409ea1fdcac25b) from {username='slave'} at 127.0.0.1:38494
I20260502 20:00:48.069010 11652 tablet_replica.cc:333] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:48.069083 11651 tablet_replica.cc:333] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:48.069199 11651 raft_consensus.cc:2243] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:48.069199 11652 raft_consensus.cc:2243] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:48.069360 11651 raft_consensus.cc:2272] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:48.069519 11652 raft_consensus.cc:2272] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:48.069963 11653 tablet_replica.cc:333] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:48.069983 11651 ts_tablet_manager.cc:1916] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:48.070134 11652 ts_tablet_manager.cc:1916] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:48.070128 11653 raft_consensus.cc:2243] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:48.070292 11653 raft_consensus.cc:2272] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:48.071065 11653 ts_tablet_manager.cc:1916] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:48.072275 11651 ts_tablet_manager.cc:1929] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:48.072350 11651 log.cc:1199] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/f9c736521db340f8a196571bae1d1beb
I20260502 20:00:48.072515 11652 ts_tablet_manager.cc:1929] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:48.072579 11652 log.cc:1199] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/f9c736521db340f8a196571bae1d1beb
I20260502 20:00:48.072613 11651 ts_tablet_manager.cc:1950] T f9c736521db340f8a196571bae1d1beb P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:48.072818 11652 ts_tablet_manager.cc:1950] T f9c736521db340f8a196571bae1d1beb P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:48.073544 10790 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet f9c736521db340f8a196571bae1d1beb (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]) successfully deleted
I20260502 20:00:48.073596 11653 ts_tablet_manager.cc:1929] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:48.073660 11653 log.cc:1199] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/f9c736521db340f8a196571bae1d1beb
I20260502 20:00:48.073900 11653 ts_tablet_manager.cc:1950] T f9c736521db340f8a196571bae1d1beb P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:48.073956 10790 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet f9c736521db340f8a196571bae1d1beb (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]) successfully deleted
I20260502 20:00:48.074829 10793 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet f9c736521db340f8a196571bae1d1beb (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]) successfully deleted
I20260502 20:00:48.074990 10773 master_runner.cc:186] Error getting master registration for 127.10.27.189:46281: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111),
I20260502 20:00:48.075110 10773 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:00:48.077798 10800 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet 7d82a249a8664df98444dbe25dd27cc4
I20260502 20:00:48.078495 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d82a249a8664df98444dbe25dd27cc4 with delete_type TABLET_DATA_DELETED (replaced by tablet c051ecfcc84f4316a9c51f96959f2076) from {username='slave'} at 127.0.0.1:38494
I20260502 20:00:48.078892 11651 tablet_replica.cc:333] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:48.079136 11651 raft_consensus.cc:2243] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:48.079397 11651 raft_consensus.cc:2272] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:48.080274 11252 tablet_service.cc:1511] Processing CreateTablet for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (DEFAULT_TABLE table=default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:48.080374 11651 ts_tablet_manager.cc:1916] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:48.080308 10806 catalog_manager.cc:5671] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130). New cstate: current_term: 1 leader_uuid: "b85d150f168f406bb31ff44150b2b1a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260502 20:00:48.080601 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34eaaaf6417a4e80b3409ea1fdcac25b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:48.081719 11603 tablet_bootstrap.cc:492] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:48.081813 11603 ts_tablet_manager.cc:1403] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
I20260502 20:00:48.082324 11603 raft_consensus.cc:359] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.082439 11603 raft_consensus.cc:385] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.082476 11603 raft_consensus.cc:740] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.082615 11651 ts_tablet_manager.cc:1929] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:48.082607 11603 consensus_queue.cc:260] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.082685 11651 log.cc:1199] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/7d82a249a8664df98444dbe25dd27cc4
I20260502 20:00:48.082811 11605 tablet_bootstrap.cc:492] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:48.082899 11603 ts_tablet_manager.cc:1434] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:00:48.083127 11651 ts_tablet_manager.cc:1950] T 7d82a249a8664df98444dbe25dd27cc4 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:48.083858 11605 tablet_bootstrap.cc:654] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.085047 10977 tablet_service.cc:1511] Processing CreateTablet for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (DEFAULT_TABLE table=default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:48.085479 10977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34eaaaf6417a4e80b3409ea1fdcac25b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:48.087559 10790 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet 7d82a249a8664df98444dbe25dd27cc4 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]) successfully deleted
I20260502 20:00:48.087647 11602 tablet_bootstrap.cc:492] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:48.088465 11111 tablet_service.cc:1511] Processing CreateTablet for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (DEFAULT_TABLE table=default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:48.088518 11605 tablet_bootstrap.cc:492] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:48.088629 11605 ts_tablet_manager.cc:1403] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260502 20:00:48.088750 11602 tablet_bootstrap.cc:654] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.088764 11111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34eaaaf6417a4e80b3409ea1fdcac25b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:48.089375 11605 raft_consensus.cc:359] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.089475 11605 raft_consensus.cc:385] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.089505 11605 raft_consensus.cc:740] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.089636 11605 consensus_queue.cc:260] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.090034 11602 tablet_bootstrap.cc:492] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:48.090093 11602 ts_tablet_manager.cc:1403] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260502 20:00:48.090502 11602 raft_consensus.cc:359] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.090596 11602 raft_consensus.cc:385] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.090641 11602 raft_consensus.cc:740] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.090775 11602 consensus_queue.cc:260] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.091182 11603 tablet_bootstrap.cc:492] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:48.091943 11602 ts_tablet_manager.cc:1434] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 20:00:48.092234 11603 tablet_bootstrap.cc:654] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.093700 11605 ts_tablet_manager.cc:1434] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260502 20:00:48.094782 11111 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d82a249a8664df98444dbe25dd27cc4 with delete_type TABLET_DATA_DELETED (replaced by tablet c051ecfcc84f4316a9c51f96959f2076) from {username='slave'} at 127.0.0.1:36722
I20260502 20:00:48.095232 10800 catalog_manager.cc:6741] ReplaceTablet: tablet 7d82a249a8664df98444dbe25dd27cc4 deleted and replaced by tablet c051ecfcc84f4316a9c51f96959f2076
I20260502 20:00:48.096237 10800 catalog_manager.cc:5763] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793) does not have the latest schema for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]). Expected version 1 got 0
W20260502 20:00:48.096691 10800 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 34eaaaf6417a4e80b3409ea1fdcac25b consensus state has no leader
I20260502 20:00:48.097424 11252 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d82a249a8664df98444dbe25dd27cc4 with delete_type TABLET_DATA_DELETED (replaced by tablet c051ecfcc84f4316a9c51f96959f2076) from {username='slave'} at 127.0.0.1:54214
I20260502 20:00:48.097452 10800 catalog_manager.cc:5763] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389) does not have the latest schema for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]). Expected version 1 got 0
I20260502 20:00:48.097592 11652 tablet_replica.cc:333] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:48.097707 11652 raft_consensus.cc:2243] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:48.097849 11652 raft_consensus.cc:2272] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:48.098410 11652 ts_tablet_manager.cc:1916] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:48.099490 10800 catalog_manager.cc:5763] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793) does not have the latest schema for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]). Expected version 1 got 0
I20260502 20:00:48.100260 10800 catalog_manager.cc:5763] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389) does not have the latest schema for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]). Expected version 1 got 0
I20260502 20:00:48.100697 11652 ts_tablet_manager.cc:1929] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:48.100764 11652 log.cc:1199] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/7d82a249a8664df98444dbe25dd27cc4
I20260502 20:00:48.100689 10800 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_b19cf190454d42ff99d3fcab96f783b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:48.100994 11653 tablet_replica.cc:333] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:48.101024 11652 ts_tablet_manager.cc:1950] T 7d82a249a8664df98444dbe25dd27cc4 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:48.101125 11653 raft_consensus.cc:2243] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:48.101258 11653 raft_consensus.cc:2272] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:48.101886 11653 ts_tablet_manager.cc:1916] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:48.102078 10790 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet 7d82a249a8664df98444dbe25dd27cc4 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]) successfully deleted
I20260502 20:00:48.104094 11653 ts_tablet_manager.cc:1929] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:48.104176 11653 log.cc:1199] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/7d82a249a8664df98444dbe25dd27cc4
I20260502 20:00:48.104424 11653 ts_tablet_manager.cc:1950] T 7d82a249a8664df98444dbe25dd27cc4 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:48.105631 10806 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56168:
name: "default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:48.107194 10793 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet 7d82a249a8664df98444dbe25dd27cc4 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]) successfully deleted
I20260502 20:00:48.109584 11603 tablet_bootstrap.cc:492] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:48.109707 11603 ts_tablet_manager.cc:1403] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20260502 20:00:48.110284 11603 raft_consensus.cc:359] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.110406 11603 raft_consensus.cc:385] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.110442 11603 raft_consensus.cc:740] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.110589 11603 consensus_queue.cc:260] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.110896 11603 ts_tablet_manager.cc:1434] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:48.115305 10977 tablet_service.cc:1511] Processing CreateTablet for tablet c051ecfcc84f4316a9c51f96959f2076 (DEFAULT_TABLE table=default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:48.115654 10977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c051ecfcc84f4316a9c51f96959f2076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:48.117909 11602 tablet_bootstrap.cc:492] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:48.119379 11602 tablet_bootstrap.cc:654] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.119444 11252 tablet_service.cc:1511] Processing CreateTablet for tablet c051ecfcc84f4316a9c51f96959f2076 (DEFAULT_TABLE table=default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:48.119737 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c051ecfcc84f4316a9c51f96959f2076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:48.121892 11605 tablet_bootstrap.cc:492] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:48.122366 11111 tablet_service.cc:1511] Processing CreateTablet for tablet c051ecfcc84f4316a9c51f96959f2076 (DEFAULT_TABLE table=default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:48.122645 11111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c051ecfcc84f4316a9c51f96959f2076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:48.122957 11605 tablet_bootstrap.cc:654] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.123594 11505 raft_consensus.cc:493] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:48.123698 11505 raft_consensus.cc:515] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.124137 11505 leader_election.cc:290] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:48.124462 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34eaaaf6417a4e80b3409ea1fdcac25b" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:48.124557 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34eaaaf6417a4e80b3409ea1fdcac25b" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:48.124594 11131 raft_consensus.cc:2468] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:48.124676 11272 raft_consensus.cc:2468] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:48.124899 10933 leader_election.cc:304] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:48.125125 11505 raft_consensus.cc:2804] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:48.125171 11505 raft_consensus.cc:493] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:48.125205 11505 raft_consensus.cc:3060] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.125953 11603 tablet_bootstrap.cc:492] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:48.126133 11505 raft_consensus.cc:515] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.126487 11505 leader_election.cc:290] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:48.126729 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34eaaaf6417a4e80b3409ea1fdcac25b" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:48.126858 11131 raft_consensus.cc:3060] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.126987 11603 tablet_bootstrap.cc:654] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:48.127074 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34eaaaf6417a4e80b3409ea1fdcac25b" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:48.127178 11272 raft_consensus.cc:3060] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.127772 11131 raft_consensus.cc:2468] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:48.128077 11272 raft_consensus.cc:2468] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:48.128109 10933 leader_election.cc:304] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:48.128275 11505 raft_consensus.cc:2804] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:48.128369 11505 raft_consensus.cc:697] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:48.128511 11505 consensus_queue.cc:237] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.134214 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.189:46281
--webserver_interface=127.10.27.189
--webserver_port=43275
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260502 20:00:48.137571 11605 tablet_bootstrap.cc:492] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:48.137707 11605 ts_tablet_manager.cc:1403] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260502 20:00:48.138341 11605 raft_consensus.cc:359] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.138473 11605 raft_consensus.cc:385] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.138512 11605 raft_consensus.cc:740] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.138652 11605 consensus_queue.cc:260] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.138855 11603 tablet_bootstrap.cc:492] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:48.139251 11603 ts_tablet_manager.cc:1403] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20260502 20:00:48.140080 11603 raft_consensus.cc:359] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.140199 11603 raft_consensus.cc:385] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.140195 11505 raft_consensus.cc:493] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:48.140239 11603 raft_consensus.cc:740] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.140290 11505 raft_consensus.cc:515] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.140400 11603 consensus_queue.cc:260] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.140890 11505 leader_election.cc:290] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:48.141254 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be812b77483246f4bfa91d217b66de5b" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:48.141397 11272 raft_consensus.cc:2468] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:48.141842 11605 ts_tablet_manager.cc:1434] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260502 20:00:48.143220 10930 leader_election.cc:304] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:48.144395 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be812b77483246f4bfa91d217b66de5b" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:48.144523 11131 raft_consensus.cc:2468] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:48.145026 11505 raft_consensus.cc:2804] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:48.145109 11505 raft_consensus.cc:493] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:48.145152 11505 raft_consensus.cc:3060] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.145437 11643 raft_consensus.cc:493] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:48.145522 11643 raft_consensus.cc:515] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.145888 11643 leader_election.cc:290] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:48.146224 11505 raft_consensus.cc:515] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.146529 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ae60584a4c449bb71ac28cb46c6f75" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:48.146588 11505 leader_election.cc:290] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:48.146646 10995 raft_consensus.cc:2468] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:48.147043 11206 leader_election.cc:304] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:48.147125 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ae60584a4c449bb71ac28cb46c6f75" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:48.147212 11643 raft_consensus.cc:2804] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:48.147234 11131 raft_consensus.cc:2468] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:48.147267 11643 raft_consensus.cc:493] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:48.147306 11643 raft_consensus.cc:3060] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.147754 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be812b77483246f4bfa91d217b66de5b" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:48.147861 11272 raft_consensus.cc:3060] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.148392 11643 raft_consensus.cc:515] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.148715 11643 leader_election.cc:290] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:00:48.148976 10790 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 34eaaaf6417a4e80b3409ea1fdcac25b consensus state has no leader
I20260502 20:00:48.140769 11603 ts_tablet_manager.cc:1434] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:48.149763 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ae60584a4c449bb71ac28cb46c6f75" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:48.149880 10995 raft_consensus.cc:3060] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.149935 11595 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:48.150054 11595 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:48.150815 10995 raft_consensus.cc:2468] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:48.150919 11602 tablet_bootstrap.cc:492] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:48.150916 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ae60584a4c449bb71ac28cb46c6f75" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:48.151038 11602 ts_tablet_manager.cc:1403] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.001s
I20260502 20:00:48.151080 11131 raft_consensus.cc:3060] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.151314 11206 leader_election.cc:304] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:48.151574 11602 raft_consensus.cc:359] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.151674 11602 raft_consensus.cc:385] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:48.151705 11602 raft_consensus.cc:740] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.151659 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be812b77483246f4bfa91d217b66de5b" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:48.151774 11132 raft_consensus.cc:3060] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.151855 11602 consensus_queue.cc:260] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.152019 11131 raft_consensus.cc:2468] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:48.152181 11602 ts_tablet_manager.cc:1434] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:00:48.152828 11132 raft_consensus.cc:2468] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:48.153641 10933 leader_election.cc:304] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:48.153800 11536 raft_consensus.cc:2804] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:48.153864 11536 raft_consensus.cc:697] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:48.153980 11536 consensus_queue.cc:237] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.148722 11272 raft_consensus.cc:2468] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:48.156195 11643 raft_consensus.cc:2804] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:48.156308 11643 raft_consensus.cc:697] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Becoming Leader. State: Replica: ade741c4062940adb2223b55187ffe72, State: Running, Role: LEADER
I20260502 20:00:48.156440 11643 consensus_queue.cc:237] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.218092 11611 raft_consensus.cc:493] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:48.218267 11611 raft_consensus.cc:515] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.218823 11611 leader_election.cc:290] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:48.219601 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bec1c114df8422099953a84b7ca0b19" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:48.219784 10995 raft_consensus.cc:2468] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:48.219821 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bec1c114df8422099953a84b7ca0b19" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:48.219986 11272 raft_consensus.cc:2468] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:48.220569 11065 leader_election.cc:304] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:48.220980 11611 raft_consensus.cc:2804] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:48.221047 11611 raft_consensus.cc:493] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:48.221091 11611 raft_consensus.cc:3060] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.223395 11611 raft_consensus.cc:515] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.224599 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bec1c114df8422099953a84b7ca0b19" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:48.224746 10995 raft_consensus.cc:3060] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.225899 10995 raft_consensus.cc:2468] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:48.226395 11065 leader_election.cc:304] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:48.226603 11612 raft_consensus.cc:2804] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:48.226707 11612 raft_consensus.cc:697] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:48.226742 11611 leader_election.cc:290] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:48.226876 11612 consensus_queue.cc:237] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.227337 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bec1c114df8422099953a84b7ca0b19" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:48.227461 11272 raft_consensus.cc:3060] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.228541 11272 raft_consensus.cc:2468] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:48.232827 11524 consensus_queue.cc:1048] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.257954 11505 consensus_queue.cc:1048] T e43e158d448442d3811dbdfe82db47ca P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.339999 11505 consensus_queue.cc:1048] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.348984 11524 consensus_queue.cc:1048] T 11548942c58f4c05bad32038a55b8f66 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.370065 11643 raft_consensus.cc:493] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:48.370236 11643 raft_consensus.cc:515] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.370766 11643 leader_election.cc:290] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:48.371582 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c051ecfcc84f4316a9c51f96959f2076" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:48.371743 11132 raft_consensus.cc:2468] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:48.372007 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c051ecfcc84f4316a9c51f96959f2076" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:48.372148 10995 raft_consensus.cc:2468] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:48.372689 11206 leader_election.cc:304] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:48.373221 11643 raft_consensus.cc:2804] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:48.373284 11643 raft_consensus.cc:493] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:48.373329 11643 raft_consensus.cc:3060] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.374396 11643 raft_consensus.cc:515] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:48.374768 11643 leader_election.cc:290] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:48.375586 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c051ecfcc84f4316a9c51f96959f2076" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:48.375713 10995 raft_consensus.cc:3060] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.376716 10995 raft_consensus.cc:2468] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:48.377044 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c051ecfcc84f4316a9c51f96959f2076" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:48.377182 11132 raft_consensus.cc:3060] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:48.378137 11132 raft_consensus.cc:2468] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:48.378611 11209 leader_election.cc:304] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:48.379017 11504 raft_consensus.cc:2804] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:48.379108 11504 raft_consensus.cc:697] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Becoming Leader. State: Replica: ade741c4062940adb2223b55187ffe72, State: Running, Role: LEADER
I20260502 20:00:48.379251 11504 consensus_queue.cc:237] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
W20260502 20:00:48.391494 11674 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:00:48.391848 11674 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:00:48.391929 11674 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:00:48.397899 11674 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 20:00:48.398084 11674 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:00:48.398125 11674 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 20:00:48.398154 11674 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 20:00:48.404114 11674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.189:46281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.27.189
--webserver_port=43275
--never_fsync=true
--heap_profile_path=/tmp/kudu.11674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:00:48.405664 11674 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:00:48.407217 11674 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:00:48.415553 11689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:48.415794 11690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:48.416014 11692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:00:48.416903 11674 server_base.cc:1061] running on GCE node
I20260502 20:00:48.417671 11674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:00:48.419005 11674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:00:48.422308 11674 hybrid_clock.cc:648] HybridClock initialized: now 1777752048422243 us; error 76 us; skew 500 ppm
I20260502 20:00:48.426779 11674 webserver.cc:492] Webserver started at http://127.10.27.189:43275/ using document root <none> and password file <none>
I20260502 20:00:48.427651 11674 fs_manager.cc:362] Metadata directory not provided
I20260502 20:00:48.427737 11674 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:00:48.434095 11674 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:48.437243 11698 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:48.438877 11674 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:48.439056 11674 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
uuid: "ef9294b460014382a2a594c77f8900d4"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:00:48.439584 11674 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:00:48.454835 11611 consensus_queue.cc:1048] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.460492 11611 consensus_queue.cc:1048] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.462118 11674 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:00:48.463258 11674 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:00:48.466759 11674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:00:48.476974 11611 consensus_queue.cc:1048] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.481606 11674 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.189:46281
I20260502 20:00:48.484846 11752 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.189:46281 every 8 connection(s)
I20260502 20:00:48.487861 11674 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
I20260502 20:00:48.496742 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 11674
I20260502 20:00:48.497607 11611 consensus_queue.cc:1048] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.504030 11755 sys_catalog.cc:263] Verifying existing consensus state
I20260502 20:00:48.509989 11045 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:00:48.514387 11180 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:00:48.517414 11755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Bootstrap starting.
I20260502 20:00:48.528384 11755 log.cc:826] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Log is configured to *not* fsync() on all Append() calls
I20260502 20:00:48.529474 11321 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:00:48.549093 11521 consensus_queue.cc:1048] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.557914 11524 consensus_queue.cc:1048] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.560336 11524 consensus_queue.cc:1048] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.571686 11504 consensus_queue.cc:1048] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.573895 11536 consensus_queue.cc:1048] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.576138 11321 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:00:48.581575 11755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Bootstrap replayed 1/1 log segments. Stats: ops{read=39 overwritten=0 applied=39 ignored=0} inserts{seen=27 ignored=0} mutations{seen=24 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:00:48.582835 11505 consensus_queue.cc:1048] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.588544 11755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Bootstrap complete.
I20260502 20:00:48.593146 11755 raft_consensus.cc:359] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:48.593633 11755 raft_consensus.cc:740] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9294b460014382a2a594c77f8900d4, State: Initialized, Role: FOLLOWER
I20260502 20:00:48.596487 11755 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 39, Last appended: 3.39, Last appended by leader: 39, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:48.598040 11755 sys_catalog.cc:565] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260502 20:00:48.609831 11782 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:00:48.610049 11782 catalog_manager.cc:1562] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: loading cluster ID for follower catalog manager: success
I20260502 20:00:48.612748 11782 catalog_manager.cc:1584] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: acquiring CA information for follower catalog manager: success
I20260502 20:00:48.614765 11782 catalog_manager.cc:1612] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 20:00:48.615763 11768 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:48.615911 11768 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:48.628175 11787 raft_consensus.cc:493] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:00:48.628852 11787 raft_consensus.cc:515] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:48.632853 10816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38315e4f56484666b5e54afad02498ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 74 } } ignore_live_leader: false dest_uuid: "b470a66ad54f46b1b44a80dd1edf214e" is_pre_election: true
I20260502 20:00:48.633436 11787 leader_election.cc:290] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
I20260502 20:00:48.659078 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38315e4f56484666b5e54afad02498ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 74 } } ignore_live_leader: false dest_uuid: "ef9294b460014382a2a594c77f8900d4" is_pre_election: true
I20260502 20:00:48.659464 11727 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38315e4f56484666b5e54afad02498ec in term 3.
I20260502 20:00:48.660022 11397 leader_election.cc:304] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4; no voters: b470a66ad54f46b1b44a80dd1edf214e
I20260502 20:00:48.660332 11787 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260502 20:00:48.660390 11787 raft_consensus.cc:493] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:00:48.660434 11787 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 3 FOLLOWER]: Advancing to term 4
I20260502 20:00:48.662890 11787 raft_consensus.cc:515] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:48.663789 10816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38315e4f56484666b5e54afad02498ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 74 } } ignore_live_leader: false dest_uuid: "b470a66ad54f46b1b44a80dd1edf214e"
I20260502 20:00:48.664788 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38315e4f56484666b5e54afad02498ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 74 } } ignore_live_leader: false dest_uuid: "ef9294b460014382a2a594c77f8900d4"
I20260502 20:00:48.664935 11727 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 3 FOLLOWER]: Advancing to term 4
I20260502 20:00:48.667192 10805 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]
I20260502 20:00:48.667400 11787 leader_election.cc:290] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 4 election: Requested vote from peers ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
I20260502 20:00:48.667965 11727 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38315e4f56484666b5e54afad02498ec in term 4.
I20260502 20:00:48.668354 11397 leader_election.cc:304] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4; no voters: b470a66ad54f46b1b44a80dd1edf214e
I20260502 20:00:48.668658 11787 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 4 FOLLOWER]: Leader election won for term 4
I20260502 20:00:48.668860 11787 raft_consensus.cc:697] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 4 LEADER]: Becoming Leader. State: Replica: 38315e4f56484666b5e54afad02498ec, State: Running, Role: LEADER
I20260502 20:00:48.669239 11787 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 3.74, Last appended by leader: 74, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:48.670794 11787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38315e4f56484666b5e54afad02498ec. Latest consensus state: current_term: 4 leader_uuid: "38315e4f56484666b5e54afad02498ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:48.671037 11787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:48.676491 11792 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 20:00:48.685257 11792 catalog_manager.cc:679] Loaded metadata for table default.table_69320349621b4b9399e4602c5d03321a [id=093f23e92a7a48d3bdc662c3b8c38342]
I20260502 20:00:48.685745 11792 catalog_manager.cc:679] Loaded metadata for table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc]
I20260502 20:00:48.686028 11792 catalog_manager.cc:679] Loaded metadata for table default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]
I20260502 20:00:48.686305 11792 catalog_manager.cc:679] Loaded metadata for table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]
I20260502 20:00:48.686546 11792 catalog_manager.cc:679] Loaded metadata for table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]
I20260502 20:00:48.686777 11792 catalog_manager.cc:679] Loaded metadata for table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]
I20260502 20:00:48.687089 11792 catalog_manager.cc:679] Loaded metadata for table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]
I20260502 20:00:48.687335 11792 catalog_manager.cc:679] Loaded metadata for table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]
I20260502 20:00:48.687564 11792 catalog_manager.cc:679] Loaded metadata for table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]
I20260502 20:00:48.687798 11792 catalog_manager.cc:679] Loaded metadata for table default.table_11635cffa19740e19919a56d36ca0879 [id=a999550aad204128ae1a88d9b965af8b]
I20260502 20:00:48.688025 11792 catalog_manager.cc:679] Loaded metadata for table default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]
I20260502 20:00:48.688251 11792 catalog_manager.cc:679] Loaded metadata for table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f]
I20260502 20:00:48.688465 11792 catalog_manager.cc:679] Loaded metadata for table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2]
I20260502 20:00:48.688673 11792 catalog_manager.cc:679] Loaded metadata for table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63]
I20260502 20:00:48.688879 11792 catalog_manager.cc:679] Loaded metadata for table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]
I20260502 20:00:48.690265 11792 tablet_loader.cc:96] loaded metadata for tablet 0ea263d32fd2405985d4514c2ff02a39 (table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f])
I20260502 20:00:48.690512 11792 tablet_loader.cc:96] loaded metadata for tablet 11548942c58f4c05bad32038a55b8f66 (table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63])
I20260502 20:00:48.690702 11792 tablet_loader.cc:96] loaded metadata for tablet 2375695de9014b60b987737fd505b224 (table default.table_11635cffa19740e19919a56d36ca0879 [id=a999550aad204128ae1a88d9b965af8b])
I20260502 20:00:48.690873 11792 tablet_loader.cc:96] loaded metadata for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b])
I20260502 20:00:48.691331 11792 tablet_loader.cc:96] loaded metadata for tablet 71894a5bf3214ed3a2329f1a2a134b19 (table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b])
I20260502 20:00:48.691964 11792 tablet_loader.cc:96] loaded metadata for tablet 9bec1c114df8422099953a84b7ca0b19 (table default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b])
I20260502 20:00:48.692181 11792 tablet_loader.cc:96] loaded metadata for tablet 9f5e048f6c304494a4aa8d0d75913b74 (table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064])
I20260502 20:00:48.692373 11792 tablet_loader.cc:96] loaded metadata for tablet b7f66a29d42c416b93bf9ec89fd53e98 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464])
I20260502 20:00:48.692561 11792 tablet_loader.cc:96] loaded metadata for tablet be812b77483246f4bfa91d217b66de5b (table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86])
I20260502 20:00:48.692744 11792 tablet_loader.cc:96] loaded metadata for tablet c051ecfcc84f4316a9c51f96959f2076 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760])
I20260502 20:00:48.692930 11792 tablet_loader.cc:96] loaded metadata for tablet c671b41464b74cd1bfcec7eb52043bd3 (table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f])
I20260502 20:00:48.693121 11792 tablet_loader.cc:96] loaded metadata for tablet d2ae60584a4c449bb71ac28cb46c6f75 (table default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e])
I20260502 20:00:48.693331 11792 tablet_loader.cc:96] loaded metadata for tablet e43e158d448442d3811dbdfe82db47ca (table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2])
I20260502 20:00:48.693526 11792 tablet_loader.cc:96] loaded metadata for tablet e6bb822f20154ceb9cf694cbd09b5a77 (table default.table_69320349621b4b9399e4602c5d03321a [id=093f23e92a7a48d3bdc662c3b8c38342])
I20260502 20:00:48.693708 11792 tablet_loader.cc:96] loaded metadata for tablet eb15659f8f6549d49f44639345471f6e (table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc])
I20260502 20:00:48.693969 11792 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 20:00:48.694713 11792 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:00:48.694777 11792 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 20:00:48.695621 11792 catalog_manager.cc:1514] Loading token signing keys...
I20260502 20:00:48.696216 11792 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Loaded TSK: 0
I20260502 20:00:48.697131 11792 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 20:00:48.697723 11792 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 20:00:48.698304 11792 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 19
I20260502 20:00:48.702988 11423 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 4 LEADER]: Rejecting Update request from peer b470a66ad54f46b1b44a80dd1edf214e for earlier term 3. Current term is 4. Ops: []
I20260502 20:00:48.706215 11793 consensus_queue.cc:1059] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 }, Status: INVALID_TERM, Last received: 3.74, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260502 20:00:48.706557 11793 consensus_queue.cc:1243] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [LEADER]: Peer 38315e4f56484666b5e54afad02498ec log is divergent from this leader: its last log entry 4.75 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 74
I20260502 20:00:48.706686 11793 raft_consensus.cc:3055] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 3 LEADER]: Stepping down as leader of term 3
I20260502 20:00:48.706774 11793 raft_consensus.cc:740] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b470a66ad54f46b1b44a80dd1edf214e, State: Running, Role: LEADER
I20260502 20:00:48.707064 11793 consensus_queue.cc:260] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 3.74, Last appended by leader: 74, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:48.707373 11793 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 3 FOLLOWER]: Advancing to term 4
I20260502 20:00:48.739679 11562 consensus_queue.cc:1048] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.742750 11710 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" instance_seqno: 1777752043533877) as {username='slave'} at 127.10.27.129:53565; Asking this server to re-register.
I20260502 20:00:48.744983 11044 heartbeater.cc:499] Master 127.10.27.190:46101 was elected leader, sending a full tablet report...
I20260502 20:00:48.747678 11045 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:48.748500 11410 catalog_manager.cc:5671] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to ade741c4062940adb2223b55187ffe72 (127.10.27.131). New cstate: current_term: 1 leader_uuid: "ade741c4062940adb2223b55187ffe72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } }
I20260502 20:00:48.749147 11410 catalog_manager.cc:5671] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130). New cstate: current_term: 1 leader_uuid: "b85d150f168f406bb31ff44150b2b1a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } }
I20260502 20:00:48.749357 11410 catalog_manager.cc:5763] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793) does not have the latest schema for tablet c051ecfcc84f4316a9c51f96959f2076 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]). Expected version 1 got 0
I20260502 20:00:48.749588 11410 catalog_manager.cc:5671] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to 858db0bc9f07476e9d1540f2b095414f (127.10.27.129). New cstate: current_term: 1 leader_uuid: "858db0bc9f07476e9d1540f2b095414f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:48.750119 11410 catalog_manager.cc:5671] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to 858db0bc9f07476e9d1540f2b095414f (127.10.27.129). New cstate: current_term: 1 leader_uuid: "858db0bc9f07476e9d1540f2b095414f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260502 20:00:48.750290 11410 catalog_manager.cc:5763] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793) does not have the latest schema for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]). Expected version 1 got 0
I20260502 20:00:48.750850 11710 ts_manager.cc:194] Registered new tserver with Master: 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:48.751588 11612 consensus_queue.cc:1048] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.752825 11180 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:00:48.754860 11709 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" instance_seqno: 1777752043728997) as {username='slave'} at 127.10.27.130:56587; Asking this server to re-register.
I20260502 20:00:48.755713 11709 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ade741c4062940adb2223b55187ffe72" instance_seqno: 1777752043938024) as {username='slave'} at 127.10.27.131:59609; Asking this server to re-register.
I20260502 20:00:48.756270 11321 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:48.757028 11180 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:48.758216 11709 ts_manager.cc:194] Registered new tserver with Master: ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:48.758992 11710 ts_manager.cc:194] Registered new tserver with Master: b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:48.765245 10816 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 4 FOLLOWER]: Refusing update from remote peer 38315e4f56484666b5e54afad02498ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 74. Preceding OpId from leader: term: 4 index: 76. (index mismatch)
I20260502 20:00:48.765909 11791 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260502 20:00:48.768741 11794 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38315e4f56484666b5e54afad02498ec. Latest consensus state: current_term: 4 leader_uuid: "38315e4f56484666b5e54afad02498ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:48.768891 11794 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:48.770394 11643 consensus_queue.cc:1048] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.771016 11794 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "38315e4f56484666b5e54afad02498ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:48.771131 11794 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:48.772456 11727 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 4 FOLLOWER]: Refusing update from remote peer 38315e4f56484666b5e54afad02498ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 39. Preceding OpId from leader: term: 4 index: 76. (index mismatch)
I20260502 20:00:48.773723 11787 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 39, Time since last communication: 0.000s
I20260502 20:00:48.781855 11521 consensus_queue.cc:1048] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:48.786115 11768 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38315e4f56484666b5e54afad02498ec. Latest consensus state: current_term: 4 leader_uuid: "38315e4f56484666b5e54afad02498ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:48.786257 11768 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:48.786373 11768 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "38315e4f56484666b5e54afad02498ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:48.786441 11768 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:48.787369 11791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "38315e4f56484666b5e54afad02498ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:48.787495 11791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:48.787750 11797 mvcc.cc:204] Tried to move back new op lower bound from 7281672391734202368 to 7281672391353024512. Current Snapshot: MvccSnapshot[applied={T|T < 7281672391734202368}]
W20260502 20:00:48.793766 11410 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet c051ecfcc84f4316a9c51f96959f2076 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet c051ecfcc84f4316a9c51f96959f2076 consensus state has no leader
I20260502 20:00:48.794894 11320 heartbeater.cc:499] Master 127.10.27.190:46101 was elected leader, sending a full tablet report...
I20260502 20:00:48.795142 11179 heartbeater.cc:499] Master 127.10.27.190:46101 was elected leader, sending a full tablet report...
I20260502 20:00:48.798069 11410 catalog_manager.cc:5763] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389) does not have the latest schema for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]). Expected version 1 got 0
I20260502 20:00:48.798202 11410 catalog_manager.cc:5671] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 reported cstate change: term changed from 0 to 1, leader changed from <none> to ade741c4062940adb2223b55187ffe72 (127.10.27.131). New cstate: current_term: 1 leader_uuid: "ade741c4062940adb2223b55187ffe72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260502 20:00:48.798377 11410 catalog_manager.cc:5763] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389) does not have the latest schema for tablet c051ecfcc84f4316a9c51f96959f2076 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]). Expected version 1 got 0
I20260502 20:00:48.799000 10802 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_11635cffa19740e19919a56d36ca0879 [id=a999550aad204128ae1a88d9b965af8b]
I20260502 20:00:48.801309 11787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "38315e4f56484666b5e54afad02498ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:48.801419 11787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:48.811749 11413 catalog_manager.cc:5763] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285) does not have the latest schema for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]). Expected version 1 got 0
I20260502 20:00:48.811893 11413 catalog_manager.cc:5763] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285) does not have the latest schema for tablet c051ecfcc84f4316a9c51f96959f2076 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]). Expected version 1 got 0
I20260502 20:00:48.813956 11412 catalog_manager.cc:5763] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793) does not have the latest schema for tablet c051ecfcc84f4316a9c51f96959f2076 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]). Expected version 1 got 0
I20260502 20:00:48.824476 11412 catalog_manager.cc:5763] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793) does not have the latest schema for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]). Expected version 1 got 0
I20260502 20:00:48.835246 11813 tablet.cc:1724] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:48.836295 11801 mvcc.cc:204] Tried to move back new op lower bound from 7281672391734202368 to 7281672391353024512. Current Snapshot: MvccSnapshot[applied={T|T < 7281672388976705536 or (T in {7281672389051793408})}]
I20260502 20:00:48.837268 11814 tablet.cc:1724] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:48.838855 11815 tablet.cc:1724] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:48.881754 10799 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_69320349621b4b9399e4602c5d03321a [id=093f23e92a7a48d3bdc662c3b8c38342]
I20260502 20:00:48.882431 11412 catalog_manager.cc:5763] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389) does not have the latest schema for tablet c051ecfcc84f4316a9c51f96959f2076 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]). Expected version 1 got 0
I20260502 20:00:48.886850 11815 tablet.cc:1724] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:48.892006 11813 tablet.cc:1724] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:48.896847 11814 tablet.cc:1724] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:48.967847 10804 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]
W20260502 20:00:48.973773 10881 hms_notification_log_listener.cc:143] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events
I20260502 20:00:48.974340 10803 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 57) took 1946 ms. Trace:
W20260502 20:00:48.974435 10800 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b19cf190454d42ff99d3fcab96f783b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260502 20:00:48.974529 10798 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56168 (request call id 58) took 1937 ms. Trace:
I20260502 20:00:48.974565 10798 rpcz_store.cc:276] 0502 20:00:47.036623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:47.977903 (+941280us) service_pool.cc:224] Handling call
0502 20:00:48.974518 (+996615us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 20:00:48.975036 10801 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 59) took 1897 ms. Trace:
I20260502 20:00:48.975090 10801 rpcz_store.cc:276] 0502 20:00:47.077120 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:47.978647 (+901527us) service_pool.cc:224] Handling call
0502 20:00:48.975018 (+996371us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 20:00:48.974411 10803 rpcz_store.cc:276] 0502 20:00:47.028233 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:47.977509 (+949276us) service_pool.cc:224] Handling call
0502 20:00:48.974319 (+996810us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260502 20:00:48.975502 11328 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.10.27.188:33369)
I20260502 20:00:48.975587 10797 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 56) took 1998 ms. Trace:
I20260502 20:00:48.975636 10797 rpcz_store.cc:276] 0502 20:00:46.977463 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:47.977131 (+999668us) service_pool.cc:224] Handling call
0502 20:00:48.975575 (+998444us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260502 20:00:48.976135 10806 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8ad450efb0df42d2bb35c3f8d3e0b78e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260502 20:00:48.976756 10805 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56168 (request call id 54) took 2101 ms. Trace:
I20260502 20:00:48.976809 10805 rpcz_store.cc:276] 0502 20:00:46.875743 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:47.779004 (+903261us) service_pool.cc:224] Handling call
0502 20:00:47.974126 (+195122us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:48.976742 (+1002616us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":30,"Hive Metastore.run_cpu_time_us":190,"Hive Metastore.run_wall_time_us":692722}
I20260502 20:00:48.977162 10802 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56168 (request call id 52) took 2199 ms. Trace:
I20260502 20:00:48.977206 10802 rpcz_store.cc:276] 0502 20:00:46.777280 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:47.706262 (+928982us) service_pool.cc:224] Handling call
0502 20:00:47.974313 (+268051us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:48.977152 (+1002839us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":692683,"Hive Metastore.run_cpu_time_us":153,"Hive Metastore.run_wall_time_us":131764}
W20260502 20:00:48.977392 11328 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.27.188:33369)
I20260502 20:00:48.977516 10799 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56168 (request call id 53) took 2149 ms. Trace:
I20260502 20:00:48.977567 10799 rpcz_store.cc:276] 0502 20:00:46.827764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:47.707345 (+879581us) service_pool.cc:224] Handling call
0502 20:00:47.974427 (+267082us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:48.977507 (+1003080us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":824403,"Hive Metastore.run_cpu_time_us":186,"Hive Metastore.run_wall_time_us":82724}
I20260502 20:00:48.978212 10804 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:56168 (request call id 55) took 2002 ms. Trace:
I20260502 20:00:48.978273 10804 rpcz_store.cc:276] 0502 20:00:46.975477 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:47.801396 (+825919us) service_pool.cc:224] Handling call
0502 20:00:47.979977 (+178581us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 20:00:48.978199 (+998222us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":901594,"Hive Metastore.run_cpu_time_us":150,"Hive Metastore.run_wall_time_us":85122}
W20260502 20:00:48.979537 10798 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.27.130:60079 (request call id 31) took 872 ms (client timeout 1000 ms). Trace:
W20260502 20:00:48.979641 10798 rpcz_store.cc:269] 0502 20:00:48.106963 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:48.974742 (+867779us) service_pool.cc:224] Handling call
0502 20:00:48.979522 (+ 4780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 20:00:48.980726 10798 master_service.cc:954] ReplaceTablet: received request to replace tablet 9f5e048f6c304494a4aa8d0d75913b74 from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:48.980931 10798 master_service.cc:954] ReplaceTablet: received request to replace tablet be812b77483246f4bfa91d217b66de5b from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:48.981134 10798 master_service.cc:954] ReplaceTablet: received request to replace tablet 71894a5bf3214ed3a2329f1a2a134b19 from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:48.981304 10798 master_service.cc:954] ReplaceTablet: received request to replace tablet b7f66a29d42c416b93bf9ec89fd53e98 from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:48.981495 10798 master_service.cc:954] ReplaceTablet: received request to replace tablet c051ecfcc84f4316a9c51f96959f2076 from {username='slave'} at 127.0.0.1:56168
I20260502 20:00:48.983104 11674 master_runner.cc:232] Existing masters have differing terms: 3 vs 4
I20260502 20:00:48.983219 11674 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:00:48.983843 10797 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 67) took 1153 ms. Trace:
I20260502 20:00:48.983898 10797 rpcz_store.cc:276] 0502 20:00:47.830373 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:48.975731 (+1145358us) service_pool.cc:224] Handling call
0502 20:00:48.983770 (+ 8039us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x55b76363e9d4. stack: 00007fb2550200af 00007fb25502069f 00007fb254af7add 000055b744a2ddce 000055b744a2de21 00007fb257def1f1 00007fb257def15f 00007fb257021241 00007fb25902b039 00007fb2590f0799 00007fb2569b91f9 00007fb2569c241d 00007fb255ff97af 00007fb255ff9063 00007fb255ffbd61 00007fb255ffa6be
0502 20:00:48.983832 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18130816}
W20260502 20:00:48.984720 10803 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.27.131:55923 (request call id 29) took 845 ms (client timeout 1000 ms). Trace:
W20260502 20:00:48.984794 10803 rpcz_store.cc:269] 0502 20:00:48.139757 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:48.975250 (+835493us) service_pool.cc:224] Handling call
0502 20:00:48.984452 (+ 9202us) spinlock_profiling.cc:243] Waited 8.93 ms on lock 0x55b76363e9d4. stack: 00007fb2550200af 00007fb25502069f 00007fb254af7add 000055b744a2ddce 000055b744a2de21 00007fb257def1f1 00007fb257def15f 00007fb257021241 00007fb25902b039 00007fb2590eeb6e 00007fb2569b906d 00007fb2569c19d0 00007fb255ff97af 00007fb255ff9063 00007fb255ffbd61 00007fb255ffa6be
0502 20:00:48.984705 (+ 253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20533632}
I20260502 20:00:48.985486 10802 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 69) took 1033 ms. Trace:
I20260502 20:00:48.985534 10802 rpcz_store.cc:276] 0502 20:00:47.952156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:48.977346 (+1025190us) service_pool.cc:224] Handling call
0502 20:00:48.985398 (+ 8052us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x55b76363e9d4. stack: 00007fb2550200af 00007fb25502069f 00007fb254af7add 000055b744a2ddce 000055b744a2de21 00007fb257def1f1 00007fb257def15f 00007fb257021241 00007fb25902b039 00007fb2590f0799 00007fb2569b91f9 00007fb2569c241d 00007fb255ff97af 00007fb255ff9063 00007fb255ffbd61 00007fb255ffa6be
0502 20:00:48.985473 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18150272}
I20260502 20:00:48.985870 10805 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 68) took 1101 ms. Trace:
I20260502 20:00:48.985916 10805 rpcz_store.cc:276] 0502 20:00:47.884196 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:48.976979 (+1092783us) service_pool.cc:224] Handling call
0502 20:00:48.985794 (+ 8815us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x55b76363e9d4. stack: 00007fb2550200af 00007fb25502069f 00007fb254af7add 000055b744a2ddce 000055b744a2de21 00007fb257def1f1 00007fb257def15f 00007fb257021241 00007fb25902b039 00007fb2590f0799 00007fb2569b91f9 00007fb2569c241d 00007fb255ff97af 00007fb255ff9063 00007fb255ffbd61 00007fb255ffa6be
0502 20:00:48.985860 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19923200}
W20260502 20:00:48.986065 11328 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.10.27.188:33369)
W20260502 20:00:48.986563 11328 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.10.27.188:33369)
W20260502 20:00:48.988893 10801 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.27.129:34997 (request call id 32) took 858 ms (client timeout 1000 ms). Trace:
W20260502 20:00:48.988961 10801 rpcz_store.cc:269] 0502 20:00:48.130510 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:48.975250 (+844740us) service_pool.cc:224] Handling call
0502 20:00:48.988617 (+ 13367us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x55b76363e9d4. stack: 00007fb2550200af 00007fb25502069f 00007fb254af7add 000055b744a2ddce 000055b744a2de21 00007fb257def1f1 00007fb257def15f 00007fb257021241 00007fb25902b039 00007fb2590eeb6e 00007fb2569b906d 00007fb2569c19d0 00007fb255ff97af 00007fb255ff9063 00007fb255ffbd61 00007fb255ffa6be
0502 20:00:48.988880 (+ 263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30038784}
I20260502 20:00:48.996270 11407 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38448:
table { table_name: "default.Table_24faf39307584530a038ed30536bd4c2" } new_table_name: "default.Table_b9b31b57bb724b299b6000678ee9e5a4" modify_external_catalogs: true
I20260502 20:00:48.996407 11404 master_service.cc:954] ReplaceTablet: received request to replace tablet 9f5e048f6c304494a4aa8d0d75913b74 from {username='slave'} at 127.0.0.1:38448
I20260502 20:00:48.996513 11409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38448:
name: "default.Table_fcdc343b9b214cd4ad8839e21ec7af0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:48.996686 11405 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38448:
table { table_name: "default.Table_0d8473dff6e244c199473f589d46be1b" } new_table_name: "default.Table_41eddb5da0424c5ea3a77e1f59af0916" modify_external_catalogs: true
I20260502 20:00:48.996842 11413 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38448:
name: "default.Table_7d6b7fac1a1a41d680d0d2c5a9806f43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:48.996858 11406 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38448:
table { table_name: "default.Table_d4efc4ecb8b04c828595edb245352971" } new_table_name: "default.Table_fd2a46a7a29e42429193d222c7c5037f" modify_external_catalogs: true
I20260502 20:00:48.996182 11411 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38448:
name: "default.Table_972ed2d875504da381cc8d7d4a7630de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:48.997090 11408 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38448:
table { table_name: "default.Table_e3ad181715724e36aa7276f9790d41bf" } new_table_name: "default.Table_9fb8cc097c6f4bd48e5f41dd70218be1" modify_external_catalogs: true
I20260502 20:00:48.996169 11410 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38448:
name: "default.Table_7ce0c3c1163d4f549db7f3204c01f5ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:48.997298 11412 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38448:
table { table_name: "default.Table_ae16bd7eeae84bcc9df91b677d29e577" } modify_external_catalogs: true
I20260502 20:00:48.997385 11412 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38448:
table { table_name: "default.Table_ae16bd7eeae84bcc9df91b677d29e577" } modify_external_catalogs: true
I20260502 20:00:49.005824 11404 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet 9f5e048f6c304494a4aa8d0d75913b74
I20260502 20:00:49.006500 11404 catalog_manager.cc:6741] ReplaceTablet: tablet 9f5e048f6c304494a4aa8d0d75913b74 deleted and replaced by tablet b3f6a9613e594f12b0e518d0b9d9e7ed
I20260502 20:00:49.006747 11404 master_service.cc:954] ReplaceTablet: received request to replace tablet be812b77483246f4bfa91d217b66de5b from {username='slave'} at 127.0.0.1:38448
I20260502 20:00:49.009646 11467 catalog_manager.cc:2772] Deleting table default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b] in response to Hive Metastore notification log event 21
I20260502 20:00:49.010394 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f5e048f6c304494a4aa8d0d75913b74 with delete_type TABLET_DATA_DELETED (replaced by tablet b3f6a9613e594f12b0e518d0b9d9e7ed) from {username='slave'} at 127.0.0.1:36974
I20260502 20:00:49.010680 11252 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f5e048f6c304494a4aa8d0d75913b74 with delete_type TABLET_DATA_DELETED (replaced by tablet b3f6a9613e594f12b0e518d0b9d9e7ed) from {username='slave'} at 127.0.0.1:46934
I20260502 20:00:49.015106 11820 tablet_replica.cc:333] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:49.015385 11820 raft_consensus.cc:2243] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.015591 11820 raft_consensus.cc:2272] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.015925 11821 tablet_replica.cc:333] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:49.016076 11821 raft_consensus.cc:2243] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.016207 11821 raft_consensus.cc:2272] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.017148 11820 ts_tablet_manager.cc:1916] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.019577 11820 ts_tablet_manager.cc:1929] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.024897 11820 log.cc:1199] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/9f5e048f6c304494a4aa8d0d75913b74
I20260502 20:00:49.025390 11820 ts_tablet_manager.cc:1950] T 9f5e048f6c304494a4aa8d0d75913b74 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:49.025673 11467 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet 9bec1c114df8422099953a84b7ca0b19
I20260502 20:00:49.026973 11467 catalog_manager.cc:2772] Deleting table default.table_11635cffa19740e19919a56d36ca0879 [id=a999550aad204128ae1a88d9b965af8b] in response to Hive Metastore notification log event 22
I20260502 20:00:49.027479 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bec1c114df8422099953a84b7ca0b19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-02 20:00:49 UTC) from {username='slave'} at 127.0.0.1:36974
I20260502 20:00:49.027633 11252 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bec1c114df8422099953a84b7ca0b19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-02 20:00:49 UTC) from {username='slave'} at 127.0.0.1:46934
I20260502 20:00:49.027697 11820 tablet_replica.cc:333] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:49.027803 11820 raft_consensus.cc:2243] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.027897 11820 raft_consensus.cc:2272] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.028972 11404 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet be812b77483246f4bfa91d217b66de5b
I20260502 20:00:49.029289 11404 catalog_manager.cc:6741] ReplaceTablet: tablet be812b77483246f4bfa91d217b66de5b deleted and replaced by tablet c65cb9d41234432c99c4dfb7240ba0ad
I20260502 20:00:49.029433 11404 master_service.cc:954] ReplaceTablet: received request to replace tablet 71894a5bf3214ed3a2329f1a2a134b19 from {username='slave'} at 127.0.0.1:38448
I20260502 20:00:49.029608 11820 ts_tablet_manager.cc:1916] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.031087 11821 ts_tablet_manager.cc:1916] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.031701 11820 ts_tablet_manager.cc:1929] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.034584 11397 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet 9f5e048f6c304494a4aa8d0d75913b74 (table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]) successfully deleted
I20260502 20:00:49.035275 11253 tablet_service.cc:1558] Processing DeleteTablet for tablet be812b77483246f4bfa91d217b66de5b with delete_type TABLET_DATA_DELETED (replaced by tablet c65cb9d41234432c99c4dfb7240ba0ad) from {username='slave'} at 127.0.0.1:46934
I20260502 20:00:49.035445 11820 log.cc:1199] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/9bec1c114df8422099953a84b7ca0b19
I20260502 20:00:49.035784 11820 ts_tablet_manager.cc:1950] T 9bec1c114df8422099953a84b7ca0b19 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:49.036837 11252 tablet_service.cc:1511] Processing CreateTablet for tablet b3f6a9613e594f12b0e518d0b9d9e7ed (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.037268 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f6a9613e594f12b0e518d0b9d9e7ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.038703 10976 tablet_service.cc:1558] Processing DeleteTablet for tablet be812b77483246f4bfa91d217b66de5b with delete_type TABLET_DATA_DELETED (replaced by tablet c65cb9d41234432c99c4dfb7240ba0ad) from {username='slave'} at 127.0.0.1:36974
I20260502 20:00:49.038820 10977 tablet_service.cc:1511] Processing CreateTablet for tablet b3f6a9613e594f12b0e518d0b9d9e7ed (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.039103 10977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f6a9613e594f12b0e518d0b9d9e7ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.039207 11397 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet 9bec1c114df8422099953a84b7ca0b19 (table default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]) successfully deleted
I20260502 20:00:49.040374 11467 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet 2375695de9014b60b987737fd505b224
I20260502 20:00:49.041014 11467 catalog_manager.cc:2772] Deleting table default.table_69320349621b4b9399e4602c5d03321a [id=093f23e92a7a48d3bdc662c3b8c38342] in response to Hive Metastore notification log event 23
I20260502 20:00:49.041352 11821 ts_tablet_manager.cc:1929] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.041455 11821 log.cc:1199] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/9f5e048f6c304494a4aa8d0d75913b74
I20260502 20:00:49.041600 11820 tablet_replica.cc:333] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:49.041798 11821 ts_tablet_manager.cc:1950] T 9f5e048f6c304494a4aa8d0d75913b74 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:49.041788 11820 raft_consensus.cc:2243] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:49.042094 11820 raft_consensus.cc:2272] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.042577 11821 tablet_replica.cc:333] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:49.042706 11820 ts_tablet_manager.cc:1916] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.042768 11821 raft_consensus.cc:2243] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.042914 11821 raft_consensus.cc:2272] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.043953 11112 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bec1c114df8422099953a84b7ca0b19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-02 20:00:49 UTC) from {username='slave'} at 127.0.0.1:34148
I20260502 20:00:49.044095 11111 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f5e048f6c304494a4aa8d0d75913b74 with delete_type TABLET_DATA_DELETED (replaced by tablet b3f6a9613e594f12b0e518d0b9d9e7ed) from {username='slave'} at 127.0.0.1:34148
I20260502 20:00:49.044270 11110 tablet_service.cc:1511] Processing CreateTablet for tablet b3f6a9613e594f12b0e518d0b9d9e7ed (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.044530 11110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f6a9613e594f12b0e518d0b9d9e7ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.045377 11397 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet 9f5e048f6c304494a4aa8d0d75913b74 (table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]) successfully deleted
I20260502 20:00:49.046605 11109 tablet_service.cc:1558] Processing DeleteTablet for tablet be812b77483246f4bfa91d217b66de5b with delete_type TABLET_DATA_DELETED (replaced by tablet c65cb9d41234432c99c4dfb7240ba0ad) from {username='slave'} at 127.0.0.1:34148
I20260502 20:00:49.046742 11108 tablet_service.cc:1558] Processing DeleteTablet for tablet 2375695de9014b60b987737fd505b224 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-02 20:00:49 UTC) from {username='slave'} at 127.0.0.1:34148
I20260502 20:00:49.047331 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet 2375695de9014b60b987737fd505b224 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-02 20:00:49 UTC) from {username='slave'} at 127.0.0.1:36974
I20260502 20:00:49.049270 11404 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet 71894a5bf3214ed3a2329f1a2a134b19
I20260502 20:00:49.049536 11404 catalog_manager.cc:6741] ReplaceTablet: tablet 71894a5bf3214ed3a2329f1a2a134b19 deleted and replaced by tablet af5837b307bb43258aa75c9a947dd5c6
I20260502 20:00:49.049674 11404 master_service.cc:954] ReplaceTablet: received request to replace tablet b7f66a29d42c416b93bf9ec89fd53e98 from {username='slave'} at 127.0.0.1:38448
I20260502 20:00:49.049983 11108 tablet_service.cc:1558] Processing DeleteTablet for tablet 71894a5bf3214ed3a2329f1a2a134b19 with delete_type TABLET_DATA_DELETED (replaced by tablet af5837b307bb43258aa75c9a947dd5c6) from {username='slave'} at 127.0.0.1:34148
I20260502 20:00:49.052361 11108 tablet_service.cc:1511] Processing CreateTablet for tablet c65cb9d41234432c99c4dfb7240ba0ad (DEFAULT_TABLE table=default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.052656 11108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65cb9d41234432c99c4dfb7240ba0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.055092 11829 tablet_replica.cc:333] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:49.055308 11820 ts_tablet_manager.cc:1929] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.055330 11829 raft_consensus.cc:2243] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:49.055457 11820 log.cc:1199] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/be812b77483246f4bfa91d217b66de5b
I20260502 20:00:49.055554 11829 raft_consensus.cc:2272] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.055676 11830 tablet_bootstrap.cc:492] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:49.056010 11820 ts_tablet_manager.cc:1950] T be812b77483246f4bfa91d217b66de5b P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:49.056161 11829 ts_tablet_manager.cc:1916] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.056979 11830 tablet_bootstrap.cc:654] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.057624 11253 tablet_service.cc:1558] Processing DeleteTablet for tablet 71894a5bf3214ed3a2329f1a2a134b19 with delete_type TABLET_DATA_DELETED (replaced by tablet af5837b307bb43258aa75c9a947dd5c6) from {username='slave'} at 127.0.0.1:46934
I20260502 20:00:49.057801 11251 tablet_service.cc:1511] Processing CreateTablet for tablet c65cb9d41234432c99c4dfb7240ba0ad (DEFAULT_TABLE table=default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.058066 11251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65cb9d41234432c99c4dfb7240ba0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.058531 11829 ts_tablet_manager.cc:1929] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.058604 11829 log.cc:1199] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/9bec1c114df8422099953a84b7ca0b19
I20260502 20:00:49.058892 11829 ts_tablet_manager.cc:1950] T 9bec1c114df8422099953a84b7ca0b19 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:49.059334 11821 ts_tablet_manager.cc:1916] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.056810 10976 tablet_service.cc:1511] Processing CreateTablet for tablet c65cb9d41234432c99c4dfb7240ba0ad (DEFAULT_TABLE table=default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.060752 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65cb9d41234432c99c4dfb7240ba0ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.061061 11252 tablet_service.cc:1558] Processing DeleteTablet for tablet 2375695de9014b60b987737fd505b224 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-02 20:00:49 UTC) from {username='slave'} at 127.0.0.1:46934
I20260502 20:00:49.061204 11821 ts_tablet_manager.cc:1929] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.061376 11821 log.cc:1199] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/9bec1c114df8422099953a84b7ca0b19
I20260502 20:00:49.061657 11821 ts_tablet_manager.cc:1950] T 9bec1c114df8422099953a84b7ca0b19 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:49.062193 11827 tablet_bootstrap.cc:492] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:49.063211 11467 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet e6bb822f20154ceb9cf694cbd09b5a77
I20260502 20:00:49.063550 11827 tablet_bootstrap.cc:654] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.063901 11467 catalog_manager.cc:2772] Deleting table default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e] in response to Hive Metastore notification log event 24
I20260502 20:00:49.064517 11828 tablet_bootstrap.cc:492] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:49.065471 11828 tablet_bootstrap.cc:654] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.065501 11829 tablet_replica.cc:333] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:49.065642 11829 raft_consensus.cc:2243] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:49.065690 11404 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet b7f66a29d42c416b93bf9ec89fd53e98
I20260502 20:00:49.065822 11829 raft_consensus.cc:2272] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.066402 11829 ts_tablet_manager.cc:1916] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.066684 11404 catalog_manager.cc:6741] ReplaceTablet: tablet b7f66a29d42c416b93bf9ec89fd53e98 deleted and replaced by tablet db76c47bb09042b5ac706c4b80fc3bb9
I20260502 20:00:49.066864 11404 master_service.cc:954] ReplaceTablet: received request to replace tablet c051ecfcc84f4316a9c51f96959f2076 from {username='slave'} at 127.0.0.1:38448
I20260502 20:00:49.067458 11400 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet 9bec1c114df8422099953a84b7ca0b19 (table default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]) successfully deleted
I20260502 20:00:49.067710 10975 tablet_service.cc:1558] Processing DeleteTablet for tablet e6bb822f20154ceb9cf694cbd09b5a77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-02 20:00:49 UTC) from {username='slave'} at 127.0.0.1:36974
I20260502 20:00:49.056938 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet 71894a5bf3214ed3a2329f1a2a134b19 with delete_type TABLET_DATA_DELETED (replaced by tablet af5837b307bb43258aa75c9a947dd5c6) from {username='slave'} at 127.0.0.1:36974
I20260502 20:00:49.068202 10975 tablet_service.cc:1558] Processing DeleteTablet for tablet b7f66a29d42c416b93bf9ec89fd53e98 with delete_type TABLET_DATA_DELETED (replaced by tablet db76c47bb09042b5ac706c4b80fc3bb9) from {username='slave'} at 127.0.0.1:36974
I20260502 20:00:49.068545 11109 tablet_service.cc:1558] Processing DeleteTablet for tablet b7f66a29d42c416b93bf9ec89fd53e98 with delete_type TABLET_DATA_DELETED (replaced by tablet db76c47bb09042b5ac706c4b80fc3bb9) from {username='slave'} at 127.0.0.1:34148
I20260502 20:00:49.068826 11251 tablet_service.cc:1558] Processing DeleteTablet for tablet b7f66a29d42c416b93bf9ec89fd53e98 with delete_type TABLET_DATA_DELETED (replaced by tablet db76c47bb09042b5ac706c4b80fc3bb9) from {username='slave'} at 127.0.0.1:46934
I20260502 20:00:49.068992 11829 ts_tablet_manager.cc:1929] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.069003 11252 tablet_service.cc:1558] Processing DeleteTablet for tablet e6bb822f20154ceb9cf694cbd09b5a77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-02 20:00:49 UTC) from {username='slave'} at 127.0.0.1:46934
I20260502 20:00:49.069108 11108 tablet_service.cc:1558] Processing DeleteTablet for tablet e6bb822f20154ceb9cf694cbd09b5a77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-02 20:00:49 UTC) from {username='slave'} at 127.0.0.1:34148
I20260502 20:00:49.070608 11108 tablet_service.cc:1511] Processing CreateTablet for tablet af5837b307bb43258aa75c9a947dd5c6 (DEFAULT_TABLE table=default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.070884 11108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5837b307bb43258aa75c9a947dd5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.071681 11252 tablet_service.cc:1511] Processing CreateTablet for tablet af5837b307bb43258aa75c9a947dd5c6 (DEFAULT_TABLE table=default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.071941 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5837b307bb43258aa75c9a947dd5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.073292 10976 tablet_service.cc:1511] Processing CreateTablet for tablet af5837b307bb43258aa75c9a947dd5c6 (DEFAULT_TABLE table=default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.074764 11467 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet d2ae60584a4c449bb71ac28cb46c6f75
I20260502 20:00:49.075014 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5837b307bb43258aa75c9a947dd5c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.075481 11109 tablet_service.cc:1558] Processing DeleteTablet for tablet d2ae60584a4c449bb71ac28cb46c6f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-02 20:00:49 UTC) from {username='slave'} at 127.0.0.1:34148
I20260502 20:00:49.075577 11821 tablet_replica.cc:333] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:49.075724 11821 raft_consensus.cc:2243] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.075899 11821 raft_consensus.cc:2272] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.080328 11820 tablet_replica.cc:333] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:49.080607 11820 raft_consensus.cc:2243] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:49.080862 11820 raft_consensus.cc:2272] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.081337 11820 ts_tablet_manager.cc:1916] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.083344 11821 ts_tablet_manager.cc:1916] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.085700 11821 ts_tablet_manager.cc:1929] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.086575 11830 tablet_bootstrap.cc:492] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:49.086869 11830 ts_tablet_manager.cc:1403] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
W20260502 20:00:49.087484 11409 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_fcdc343b9b214cd4ad8839e21ec7af0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260502 20:00:49.087565 11830 raft_consensus.cc:359] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.087680 11830 raft_consensus.cc:385] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.087716 11830 raft_consensus.cc:740] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.087850 11830 consensus_queue.cc:260] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.088199 11830 ts_tablet_manager.cc:1434] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260502 20:00:49.089288 11413 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 20:00:49.090149 11411 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_972ed2d875504da381cc8d7d4a7630de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260502 20:00:49.090580 11830 tablet_bootstrap.cc:492] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
W20260502 20:00:49.092096 11410 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7ce0c3c1163d4f549db7f3204c01f5ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260502 20:00:49.092976 11404 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet c051ecfcc84f4316a9c51f96959f2076
I20260502 20:00:49.093587 11108 tablet_service.cc:1558] Processing DeleteTablet for tablet c051ecfcc84f4316a9c51f96959f2076 with delete_type TABLET_DATA_DELETED (replaced by tablet 2bf50334eb414d38ac3c09bcacb6d9bb) from {username='slave'} at 127.0.0.1:34148
I20260502 20:00:49.094130 11821 log.cc:1199] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/be812b77483246f4bfa91d217b66de5b
I20260502 20:00:49.094485 11821 ts_tablet_manager.cc:1950] T be812b77483246f4bfa91d217b66de5b P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:49.069119 11829 log.cc:1199] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/9f5e048f6c304494a4aa8d0d75913b74
I20260502 20:00:49.095091 11829 ts_tablet_manager.cc:1950] T 9f5e048f6c304494a4aa8d0d75913b74 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:49.096527 11821 tablet_replica.cc:333] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:49.096729 11821 raft_consensus.cc:2243] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.096899 11821 raft_consensus.cc:2272] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.097553 11827 tablet_bootstrap.cc:492] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:49.097723 11827 ts_tablet_manager.cc:1403] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.003s
I20260502 20:00:49.098331 11827 raft_consensus.cc:359] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.098531 11827 raft_consensus.cc:385] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.098616 11827 raft_consensus.cc:740] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.098838 11827 consensus_queue.cc:260] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.099170 11404 catalog_manager.cc:6741] ReplaceTablet: tablet c051ecfcc84f4316a9c51f96959f2076 deleted and replaced by tablet 2bf50334eb414d38ac3c09bcacb6d9bb
I20260502 20:00:49.095652 11830 tablet_bootstrap.cc:654] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.098035 11108 tablet_service.cc:1511] Processing CreateTablet for tablet db76c47bb09042b5ac706c4b80fc3bb9 (DEFAULT_TABLE table=default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.100178 11108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db76c47bb09042b5ac706c4b80fc3bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.101848 11827 ts_tablet_manager.cc:1434] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260502 20:00:49.102176 11400 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet 9f5e048f6c304494a4aa8d0d75913b74 (table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]) successfully deleted
I20260502 20:00:49.104231 11827 tablet_bootstrap.cc:492] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:49.105454 11828 tablet_bootstrap.cc:492] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:49.105556 11828 ts_tablet_manager.cc:1403] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.000s
I20260502 20:00:49.105419 11827 tablet_bootstrap.cc:654] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.106225 11828 raft_consensus.cc:359] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.106413 11828 raft_consensus.cc:385] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.106483 11828 raft_consensus.cc:740] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.106673 11828 consensus_queue.cc:260] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.108227 11828 ts_tablet_manager.cc:1434] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 20:00:49.108469 11828 tablet_bootstrap.cc:492] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:49.109169 11252 tablet_service.cc:1558] Processing DeleteTablet for tablet d2ae60584a4c449bb71ac28cb46c6f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-02 20:00:49 UTC) from {username='slave'} at 127.0.0.1:46934
I20260502 20:00:49.109648 10975 tablet_service.cc:1558] Processing DeleteTablet for tablet c051ecfcc84f4316a9c51f96959f2076 with delete_type TABLET_DATA_DELETED (replaced by tablet 2bf50334eb414d38ac3c09bcacb6d9bb) from {username='slave'} at 127.0.0.1:36974
I20260502 20:00:49.109764 11397 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet be812b77483246f4bfa91d217b66de5b (table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]) successfully deleted
I20260502 20:00:49.109951 11397 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet 9bec1c114df8422099953a84b7ca0b19 (table default.table_a6206a3729bf45dd8fcbcd4401f97845 [id=c0ef35bd37c5491084f6c10c673cf87b]) successfully deleted
I20260502 20:00:49.110049 11397 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet be812b77483246f4bfa91d217b66de5b (table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]) successfully deleted
I20260502 20:00:49.109740 11828 tablet_bootstrap.cc:654] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.113118 11252 tablet_service.cc:1511] Processing CreateTablet for tablet db76c47bb09042b5ac706c4b80fc3bb9 (DEFAULT_TABLE table=default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.113437 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db76c47bb09042b5ac706c4b80fc3bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.115231 11820 ts_tablet_manager.cc:1929] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.115415 11820 log.cc:1199] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/2375695de9014b60b987737fd505b224
I20260502 20:00:49.115402 11821 ts_tablet_manager.cc:1916] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.115767 11820 ts_tablet_manager.cc:1950] T 2375695de9014b60b987737fd505b224 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:49.116528 10975 tablet_service.cc:1511] Processing CreateTablet for tablet db76c47bb09042b5ac706c4b80fc3bb9 (DEFAULT_TABLE table=default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.116833 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db76c47bb09042b5ac706c4b80fc3bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.116852 11252 tablet_service.cc:1558] Processing DeleteTablet for tablet c051ecfcc84f4316a9c51f96959f2076 with delete_type TABLET_DATA_DELETED (replaced by tablet 2bf50334eb414d38ac3c09bcacb6d9bb) from {username='slave'} at 127.0.0.1:46934
I20260502 20:00:49.117345 10976 tablet_service.cc:1558] Processing DeleteTablet for tablet d2ae60584a4c449bb71ac28cb46c6f75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-02 20:00:49 UTC) from {username='slave'} at 127.0.0.1:36974
I20260502 20:00:49.117553 11821 ts_tablet_manager.cc:1929] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.117619 11821 log.cc:1199] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/71894a5bf3214ed3a2329f1a2a134b19
I20260502 20:00:49.117858 11821 ts_tablet_manager.cc:1950] T 71894a5bf3214ed3a2329f1a2a134b19 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:49.121896 11820 tablet_replica.cc:333] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:49.122107 11820 raft_consensus.cc:2243] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.122256 11820 raft_consensus.cc:2272] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.122673 11820 ts_tablet_manager.cc:1916] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.099592 11829 tablet_replica.cc:333] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:49.123275 11829 raft_consensus.cc:2243] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.123407 11829 raft_consensus.cc:2272] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.124325 11108 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf50334eb414d38ac3c09bcacb6d9bb (DEFAULT_TABLE table=default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.124599 11108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf50334eb414d38ac3c09bcacb6d9bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.124889 11397 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet 2375695de9014b60b987737fd505b224 (table default.table_11635cffa19740e19919a56d36ca0879 [id=a999550aad204128ae1a88d9b965af8b]) successfully deleted
I20260502 20:00:49.125443 11252 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf50334eb414d38ac3c09bcacb6d9bb (DEFAULT_TABLE table=default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.125684 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf50334eb414d38ac3c09bcacb6d9bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.128356 10975 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf50334eb414d38ac3c09bcacb6d9bb (DEFAULT_TABLE table=default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.128638 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf50334eb414d38ac3c09bcacb6d9bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.128767 11820 ts_tablet_manager.cc:1929] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.128840 11820 log.cc:1199] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/e6bb822f20154ceb9cf694cbd09b5a77
I20260502 20:00:49.129105 11820 ts_tablet_manager.cc:1950] T e6bb822f20154ceb9cf694cbd09b5a77 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:49.129637 11829 ts_tablet_manager.cc:1916] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.131541 11830 tablet_bootstrap.cc:492] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:49.131696 11830 ts_tablet_manager.cc:1403] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.001s
I20260502 20:00:49.131891 11821 tablet_replica.cc:333] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:49.132038 11821 raft_consensus.cc:2243] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.132081 11397 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet 71894a5bf3214ed3a2329f1a2a134b19 (table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]) successfully deleted
I20260502 20:00:49.132158 11821 raft_consensus.cc:2272] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.132532 11821 ts_tablet_manager.cc:1916] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.132952 11830 raft_consensus.cc:359] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.133122 11830 raft_consensus.cc:385] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.133193 11830 raft_consensus.cc:740] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.134032 11830 consensus_queue.cc:260] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.134630 11821 ts_tablet_manager.cc:1929] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.134702 11821 log.cc:1199] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/2375695de9014b60b987737fd505b224
I20260502 20:00:49.135351 11827 tablet_bootstrap.cc:492] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:49.135442 11827 ts_tablet_manager.cc:1403] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.000s
I20260502 20:00:49.135939 11827 raft_consensus.cc:359] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.136054 11827 raft_consensus.cc:385] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.136086 11827 raft_consensus.cc:740] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.136238 11827 consensus_queue.cc:260] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.138164 11830 ts_tablet_manager.cc:1434] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260502 20:00:49.140002 11827 ts_tablet_manager.cc:1434] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260502 20:00:49.141326 11827 tablet_bootstrap.cc:492] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:49.141726 11830 tablet_bootstrap.cc:492] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:49.142599 11827 tablet_bootstrap.cc:654] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.142807 11830 tablet_bootstrap.cc:654] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.145160 11397 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet e6bb822f20154ceb9cf694cbd09b5a77 (table default.table_69320349621b4b9399e4602c5d03321a [id=093f23e92a7a48d3bdc662c3b8c38342]) successfully deleted
I20260502 20:00:49.146725 11829 ts_tablet_manager.cc:1929] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.147050 11829 log.cc:1199] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/be812b77483246f4bfa91d217b66de5b
I20260502 20:00:49.147231 11820 tablet_replica.cc:333] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:49.147576 11829 ts_tablet_manager.cc:1950] T be812b77483246f4bfa91d217b66de5b P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:49.147756 11820 raft_consensus.cc:2243] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.147934 11820 raft_consensus.cc:2272] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.148670 11829 tablet_replica.cc:333] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:49.148773 11400 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet be812b77483246f4bfa91d217b66de5b (table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]) successfully deleted
I20260502 20:00:49.149631 11829 raft_consensus.cc:2243] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.150568 11829 raft_consensus.cc:2272] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.150792 11828 tablet_bootstrap.cc:492] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:49.150889 11828 ts_tablet_manager.cc:1403] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.000s
I20260502 20:00:49.151029 11829 ts_tablet_manager.cc:1916] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.151293 11820 ts_tablet_manager.cc:1916] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.151516 11828 raft_consensus.cc:359] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.151638 11828 raft_consensus.cc:385] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.151672 11828 raft_consensus.cc:740] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.151787 11828 consensus_queue.cc:260] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.152025 11828 ts_tablet_manager.cc:1434] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:49.152199 11828 tablet_bootstrap.cc:492] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:49.153175 11828 tablet_bootstrap.cc:654] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.153350 11827 tablet_bootstrap.cc:492] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:49.153420 11820 ts_tablet_manager.cc:1929] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.153434 11827 ts_tablet_manager.cc:1403] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20260502 20:00:49.153481 11820 log.cc:1199] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/71894a5bf3214ed3a2329f1a2a134b19
I20260502 20:00:49.153730 11820 ts_tablet_manager.cc:1950] T 71894a5bf3214ed3a2329f1a2a134b19 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:49.153934 11827 raft_consensus.cc:359] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.154138 11827 raft_consensus.cc:385] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.154222 11827 raft_consensus.cc:740] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.154264 11820 tablet_replica.cc:333] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:49.154625 11827 consensus_queue.cc:260] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.155686 11397 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet 71894a5bf3214ed3a2329f1a2a134b19 (table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]) successfully deleted
I20260502 20:00:49.155938 11404 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38448:
name: "default.Table_8fe0445705b144e5adbda1bd0c71ba52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:49.156930 11827 ts_tablet_manager.cc:1434] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260502 20:00:49.157212 11827 tablet_bootstrap.cc:492] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:49.159655 11827 tablet_bootstrap.cc:654] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.160686 11829 ts_tablet_manager.cc:1929] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.162667 11821 ts_tablet_manager.cc:1950] T 2375695de9014b60b987737fd505b224 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:49.164170 10800 catalog_manager.cc:2174] created HMS catalog entry for table [id=33b0206efcd84429a0b2bc366a81e1fb]
W20260502 20:00:49.164764 10800 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica b470a66ad54f46b1b44a80dd1edf214e is not leader of this config: current role FOLLOWER
I20260502 20:00:49.162761 11830 tablet_bootstrap.cc:492] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:49.165279 11830 ts_tablet_manager.cc:1403] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20260502 20:00:49.165797 11830 raft_consensus.cc:359] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.158120 11505 raft_consensus.cc:493] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:49.165896 11830 raft_consensus.cc:385] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.165926 11830 raft_consensus.cc:740] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.166039 11830 consensus_queue.cc:260] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.165963 11505 raft_consensus.cc:515] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.166316 11830 ts_tablet_manager.cc:1434] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:49.166571 11505 leader_election.cc:290] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:49.167160 11820 raft_consensus.cc:2243] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.167297 11820 raft_consensus.cc:2272] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.167539 11821 tablet_replica.cc:333] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:49.167656 11821 raft_consensus.cc:2243] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:49.167706 11820 ts_tablet_manager.cc:1916] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.167830 11821 raft_consensus.cc:2272] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.168064 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65cb9d41234432c99c4dfb7240ba0ad" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:49.168176 11272 raft_consensus.cc:2468] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:49.168192 11821 ts_tablet_manager.cc:1916] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.170029 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65cb9d41234432c99c4dfb7240ba0ad" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:49.170161 11131 raft_consensus.cc:2468] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:49.170403 11821 ts_tablet_manager.cc:1929] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:49.170398 11820 ts_tablet_manager.cc:1929] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:49.170467 11821 log.cc:1199] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/b7f66a29d42c416b93bf9ec89fd53e98
I20260502 20:00:49.170472 11820 log.cc:1199] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/b7f66a29d42c416b93bf9ec89fd53e98
I20260502 20:00:49.170722 11821 ts_tablet_manager.cc:1950] T b7f66a29d42c416b93bf9ec89fd53e98 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:49.170745 11820 ts_tablet_manager.cc:1950] T b7f66a29d42c416b93bf9ec89fd53e98 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:49.173060 10930 leader_election.cc:304] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:49.173266 11505 raft_consensus.cc:2804] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:49.173329 11505 raft_consensus.cc:493] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:49.173369 11505 raft_consensus.cc:3060] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.174374 11505 raft_consensus.cc:515] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.174777 11505 leader_election.cc:290] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:49.175697 11820 tablet_replica.cc:333] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:49.175825 11820 raft_consensus.cc:2243] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.175864 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65cb9d41234432c99c4dfb7240ba0ad" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:49.175935 11820 raft_consensus.cc:2272] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.175997 11272 raft_consensus.cc:3060] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.176559 11820 ts_tablet_manager.cc:1916] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.176929 11272 raft_consensus.cc:2468] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:49.177338 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65cb9d41234432c99c4dfb7240ba0ad" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:49.177454 11131 raft_consensus.cc:3060] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.178314 11131 raft_consensus.cc:2468] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:49.178597 11820 ts_tablet_manager.cc:1929] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:49.178701 11820 log.cc:1199] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/c051ecfcc84f4316a9c51f96959f2076
I20260502 20:00:49.178766 10930 leader_election.cc:304] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:49.179049 11820 ts_tablet_manager.cc:1950] T c051ecfcc84f4316a9c51f96959f2076 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:49.179587 11827 tablet_bootstrap.cc:492] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:49.179698 11827 ts_tablet_manager.cc:1403] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.002s
I20260502 20:00:49.179845 11820 tablet_replica.cc:333] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:49.179997 11820 raft_consensus.cc:2243] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.180155 11820 raft_consensus.cc:2272] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.180208 11827 raft_consensus.cc:359] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.180311 11827 raft_consensus.cc:385] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.180358 11827 raft_consensus.cc:740] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.180516 11827 consensus_queue.cc:260] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.180931 11820 ts_tablet_manager.cc:1916] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.181528 11397 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet b7f66a29d42c416b93bf9ec89fd53e98 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]) successfully deleted
I20260502 20:00:49.181704 11397 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet c051ecfcc84f4316a9c51f96959f2076 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]) successfully deleted
I20260502 20:00:49.181813 11397 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet 2375695de9014b60b987737fd505b224 (table default.table_11635cffa19740e19919a56d36ca0879 [id=a999550aad204128ae1a88d9b965af8b]) successfully deleted
I20260502 20:00:49.182310 11827 ts_tablet_manager.cc:1434] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260502 20:00:49.182543 11827 tablet_bootstrap.cc:492] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:49.183569 11820 ts_tablet_manager.cc:1929] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.183717 11820 log.cc:1199] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/d2ae60584a4c449bb71ac28cb46c6f75
I20260502 20:00:49.184096 11820 ts_tablet_manager.cc:1950] T d2ae60584a4c449bb71ac28cb46c6f75 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:49.184679 11827 tablet_bootstrap.cc:654] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.184911 11397 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet d2ae60584a4c449bb71ac28cb46c6f75 (table default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]) successfully deleted
I20260502 20:00:49.186009 11827 tablet_bootstrap.cc:492] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:49.186101 11505 raft_consensus.cc:2804] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:49.186200 11505 raft_consensus.cc:697] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:49.186307 11827 ts_tablet_manager.cc:1403] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260502 20:00:49.186362 11505 consensus_queue.cc:237] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.186964 11827 raft_consensus.cc:359] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.187150 11827 raft_consensus.cc:385] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.187233 11827 raft_consensus.cc:740] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.187431 11827 consensus_queue.cc:260] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.188251 11827 ts_tablet_manager.cc:1434] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260502 20:00:49.191453 11830 tablet_bootstrap.cc:492] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:49.193282 11821 tablet_replica.cc:333] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:49.193486 11821 raft_consensus.cc:2243] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.193567 11397 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet b7f66a29d42c416b93bf9ec89fd53e98 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]) successfully deleted
I20260502 20:00:49.193653 11821 raft_consensus.cc:2272] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.194125 11821 ts_tablet_manager.cc:1916] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.194329 11830 tablet_bootstrap.cc:654] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.194990 11829 log.cc:1199] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/2375695de9014b60b987737fd505b224
I20260502 20:00:49.195408 11830 tablet_bootstrap.cc:492] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:49.195582 11830 ts_tablet_manager.cc:1403] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260502 20:00:49.196375 11821 ts_tablet_manager.cc:1929] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.196419 11829 ts_tablet_manager.cc:1950] T 2375695de9014b60b987737fd505b224 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:49.196375 11830 raft_consensus.cc:359] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.196586 11830 raft_consensus.cc:385] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.196661 11830 raft_consensus.cc:740] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.196871 11830 consensus_queue.cc:260] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.196980 11821 log.cc:1199] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/e6bb822f20154ceb9cf694cbd09b5a77
I20260502 20:00:49.197259 11830 ts_tablet_manager.cc:1434] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 20:00:49.197257 11821 ts_tablet_manager.cc:1950] T e6bb822f20154ceb9cf694cbd09b5a77 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:49.197568 11830 tablet_bootstrap.cc:492] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:49.197789 11821 tablet_replica.cc:333] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:49.197903 11821 raft_consensus.cc:2243] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:49.198071 11821 raft_consensus.cc:2272] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.198598 11821 ts_tablet_manager.cc:1916] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.198649 11397 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet e6bb822f20154ceb9cf694cbd09b5a77 (table default.table_69320349621b4b9399e4602c5d03321a [id=093f23e92a7a48d3bdc662c3b8c38342]) successfully deleted
I20260502 20:00:49.199051 11611 raft_consensus.cc:493] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:49.199131 11611 raft_consensus.cc:515] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.199465 11611 leader_election.cc:290] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:49.200085 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db76c47bb09042b5ac706c4b80fc3bb9" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:49.200300 11830 tablet_bootstrap.cc:654] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.200680 11821 ts_tablet_manager.cc:1929] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.200744 11821 log.cc:1199] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/d2ae60584a4c449bb71ac28cb46c6f75
W20260502 20:00:49.200789 11065 leader_election.cc:343] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Illegal state: must be running to vote when last-logged opid is not known
I20260502 20:00:49.200981 11821 ts_tablet_manager.cc:1950] T d2ae60584a4c449bb71ac28cb46c6f75 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:49.201547 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db76c47bb09042b5ac706c4b80fc3bb9" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:49.201689 11272 raft_consensus.cc:2468] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:49.202147 11065 leader_election.cc:304] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters: 858db0bc9f07476e9d1540f2b095414f
I20260502 20:00:49.202494 11611 raft_consensus.cc:2804] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:49.202550 11611 raft_consensus.cc:493] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:49.202589 11611 raft_consensus.cc:3060] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.202900 11397 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet d2ae60584a4c449bb71ac28cb46c6f75 (table default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]) successfully deleted
I20260502 20:00:49.203197 11821 tablet_replica.cc:333] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:49.203339 11821 raft_consensus.cc:2243] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:49.203529 11821 raft_consensus.cc:2272] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.203585 11611 raft_consensus.cc:515] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.203928 11611 leader_election.cc:290] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:49.204101 11821 ts_tablet_manager.cc:1916] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.204600 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db76c47bb09042b5ac706c4b80fc3bb9" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
W20260502 20:00:49.205271 11065 leader_election.cc:343] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Illegal state: must be running to vote when last-logged opid is not known
I20260502 20:00:49.205593 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db76c47bb09042b5ac706c4b80fc3bb9" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:49.205693 11272 raft_consensus.cc:3060] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.206233 11821 ts_tablet_manager.cc:1929] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:49.206292 11821 log.cc:1199] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/c051ecfcc84f4316a9c51f96959f2076
I20260502 20:00:49.206539 11821 ts_tablet_manager.cc:1950] T c051ecfcc84f4316a9c51f96959f2076 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:49.206615 11272 raft_consensus.cc:2468] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:49.207026 11065 leader_election.cc:304] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters: 858db0bc9f07476e9d1540f2b095414f
I20260502 20:00:49.207530 11828 tablet_bootstrap.cc:492] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:49.207620 11828 ts_tablet_manager.cc:1403] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.000s
I20260502 20:00:49.207823 11397 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet c051ecfcc84f4316a9c51f96959f2076 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]) successfully deleted
I20260502 20:00:49.208173 11828 raft_consensus.cc:359] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.208261 11828 raft_consensus.cc:385] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.208283 11828 raft_consensus.cc:740] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.208428 11828 consensus_queue.cc:260] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.208712 11828 ts_tablet_manager.cc:1434] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:49.208863 11828 tablet_bootstrap.cc:492] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:49.209669 11828 tablet_bootstrap.cc:654] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.210153 11562 raft_consensus.cc:2804] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:49.210258 11562 raft_consensus.cc:697] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:49.210386 11562 consensus_queue.cc:237] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.223495 11828 tablet_bootstrap.cc:492] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:49.223623 11828 ts_tablet_manager.cc:1403] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260502 20:00:49.223824 11400 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet 2375695de9014b60b987737fd505b224 (table default.table_11635cffa19740e19919a56d36ca0879 [id=a999550aad204128ae1a88d9b965af8b]) successfully deleted
I20260502 20:00:49.224104 11829 tablet_replica.cc:333] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:49.224261 11829 raft_consensus.cc:2243] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:49.224228 11828 raft_consensus.cc:359] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.224354 11828 raft_consensus.cc:385] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.224385 11828 raft_consensus.cc:740] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.224514 11829 raft_consensus.cc:2272] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.224520 11828 consensus_queue.cc:260] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.224828 11828 ts_tablet_manager.cc:1434] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:49.225052 11828 tablet_bootstrap.cc:492] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:49.225091 11829 ts_tablet_manager.cc:1916] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.226235 11828 tablet_bootstrap.cc:654] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.227377 11829 ts_tablet_manager.cc:1929] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.227449 11829 log.cc:1199] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/71894a5bf3214ed3a2329f1a2a134b19
I20260502 20:00:49.227890 11829 ts_tablet_manager.cc:1950] T 71894a5bf3214ed3a2329f1a2a134b19 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:49.229826 11400 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet 71894a5bf3214ed3a2329f1a2a134b19 (table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]) successfully deleted
I20260502 20:00:49.230108 11829 tablet_replica.cc:333] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:49.230262 11829 raft_consensus.cc:2243] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.230393 11829 raft_consensus.cc:2272] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.231180 11829 ts_tablet_manager.cc:1916] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.233887 11829 ts_tablet_manager.cc:1929] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:49.233994 11829 log.cc:1199] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/b7f66a29d42c416b93bf9ec89fd53e98
I20260502 20:00:49.234265 11829 ts_tablet_manager.cc:1950] T b7f66a29d42c416b93bf9ec89fd53e98 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:49.234675 11828 tablet_bootstrap.cc:492] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:49.234767 11828 ts_tablet_manager.cc:1403] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260502 20:00:49.234997 11400 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet b7f66a29d42c416b93bf9ec89fd53e98 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]) successfully deleted
I20260502 20:00:49.235397 11828 raft_consensus.cc:359] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.235508 11828 raft_consensus.cc:385] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.235541 11828 raft_consensus.cc:740] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.235684 11830 tablet_bootstrap.cc:492] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:49.235675 11828 consensus_queue.cc:260] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.235755 11830 ts_tablet_manager.cc:1403] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.001s
I20260502 20:00:49.235991 11828 ts_tablet_manager.cc:1434] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:49.236238 11830 raft_consensus.cc:359] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.236342 11830 raft_consensus.cc:385] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.236373 11830 raft_consensus.cc:740] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.236475 11830 consensus_queue.cc:260] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.236732 11830 ts_tablet_manager.cc:1434] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:00:49.236939 11829 tablet_replica.cc:333] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:49.237054 11829 raft_consensus.cc:2243] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:49.237231 11829 raft_consensus.cc:2272] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.240177 11829 ts_tablet_manager.cc:1916] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.240928 11504 raft_consensus.cc:493] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:49.241039 11504 raft_consensus.cc:515] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.241467 11504 leader_election.cc:290] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:49.241744 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf50334eb414d38ac3c09bcacb6d9bb" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:49.241875 10995 raft_consensus.cc:2468] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:49.242115 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf50334eb414d38ac3c09bcacb6d9bb" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:49.242235 11131 raft_consensus.cc:2468] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:49.242569 11206 leader_election.cc:304] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:49.242889 11504 raft_consensus.cc:2804] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:49.242978 11504 raft_consensus.cc:493] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:49.243019 11504 raft_consensus.cc:3060] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.244041 11504 raft_consensus.cc:515] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.244400 11504 leader_election.cc:290] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:49.244822 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf50334eb414d38ac3c09bcacb6d9bb" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:49.244922 11131 raft_consensus.cc:3060] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.245291 11829 ts_tablet_manager.cc:1929] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.245350 11829 log.cc:1199] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/e6bb822f20154ceb9cf694cbd09b5a77
I20260502 20:00:49.245657 11829 ts_tablet_manager.cc:1950] T e6bb822f20154ceb9cf694cbd09b5a77 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:49.245913 11131 raft_consensus.cc:2468] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:49.246238 11829 tablet_replica.cc:333] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:49.246359 11829 raft_consensus.cc:2243] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.246446 11829 raft_consensus.cc:2272] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.247150 11400 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet e6bb822f20154ceb9cf694cbd09b5a77 (table default.table_69320349621b4b9399e4602c5d03321a [id=093f23e92a7a48d3bdc662c3b8c38342]) successfully deleted
I20260502 20:00:49.248041 11829 ts_tablet_manager.cc:1916] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.250065 11829 ts_tablet_manager.cc:1929] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:49.250654 11829 log.cc:1199] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/d2ae60584a4c449bb71ac28cb46c6f75
I20260502 20:00:49.250996 11829 ts_tablet_manager.cc:1950] T d2ae60584a4c449bb71ac28cb46c6f75 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:49.252032 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf50334eb414d38ac3c09bcacb6d9bb" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:49.252164 10995 raft_consensus.cc:3060] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.252390 11400 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet d2ae60584a4c449bb71ac28cb46c6f75 (table default.table_b451db44fa8e4d43a95881c29b8c60da [id=30cd302de7a94d7e8623f809030f7c7e]) successfully deleted
I20260502 20:00:49.253289 10995 raft_consensus.cc:2468] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:49.253520 11829 tablet_replica.cc:333] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:49.253644 11829 raft_consensus.cc:2243] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:49.253746 11829 raft_consensus.cc:2272] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:49.253998 11209 leader_election.cc:304] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:49.255194 11504 raft_consensus.cc:2804] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:49.255312 11504 raft_consensus.cc:697] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Becoming Leader. State: Replica: ade741c4062940adb2223b55187ffe72, State: Running, Role: LEADER
I20260502 20:00:49.255456 11504 consensus_queue.cc:237] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.256589 11829 ts_tablet_manager.cc:1916] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:49.258755 11829 ts_tablet_manager.cc:1929] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:49.258882 11829 log.cc:1199] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/c051ecfcc84f4316a9c51f96959f2076
I20260502 20:00:49.259224 11829 ts_tablet_manager.cc:1950] T c051ecfcc84f4316a9c51f96959f2076 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:49.259958 11400 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet c051ecfcc84f4316a9c51f96959f2076 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]) successfully deleted
W20260502 20:00:49.262355 10790 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 34eaaaf6417a4e80b3409ea1fdcac25b consensus state has no leader
I20260502 20:00:49.271198 10806 catalog_manager.cc:2174] created HMS catalog entry for table [id=7d9fa0bb8a9b4877b6bbbac853119f8d]
W20260502 20:00:49.271790 10806 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica b470a66ad54f46b1b44a80dd1edf214e is not leader of this config: current role FOLLOWER
I20260502 20:00:49.280828 11407 catalog_manager.cc:3502] renamed table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064] in HMS: new name default.table_b9b31b57bb724b299b6000678ee9e5a4
I20260502 20:00:49.304177 11409 catalog_manager.cc:2174] created HMS catalog entry for table [id=a43281e34df745e1a9295400ec974150]
I20260502 20:00:49.312656 11409 catalog_manager.cc:5671] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to 858db0bc9f07476e9d1540f2b095414f (127.10.27.129). New cstate: current_term: 1 leader_uuid: "858db0bc9f07476e9d1540f2b095414f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:49.327018 11611 raft_consensus.cc:493] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:49.327158 11611 raft_consensus.cc:515] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.327626 11611 leader_election.cc:290] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:49.328418 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f6a9613e594f12b0e518d0b9d9e7ed" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:49.328583 11272 raft_consensus.cc:2468] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:49.328838 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f6a9613e594f12b0e518d0b9d9e7ed" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:49.328970 10995 raft_consensus.cc:2468] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:49.329538 11065 leader_election.cc:304] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:49.331128 11611 raft_consensus.cc:2804] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:49.331192 11611 raft_consensus.cc:493] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:49.331228 11611 raft_consensus.cc:3060] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.332321 11611 raft_consensus.cc:515] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.332690 11611 leader_election.cc:290] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:49.333438 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f6a9613e594f12b0e518d0b9d9e7ed" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:49.333568 10995 raft_consensus.cc:3060] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.334635 10995 raft_consensus.cc:2468] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:49.335081 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f6a9613e594f12b0e518d0b9d9e7ed" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:49.335242 11272 raft_consensus.cc:3060] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.336329 11272 raft_consensus.cc:2468] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:49.336918 11065 leader_election.cc:304] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:49.340123 11409 catalog_manager.cc:5763] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285) does not have the latest schema for tablet 2bf50334eb414d38ac3c09bcacb6d9bb (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]). Expected version 1 got 0
I20260502 20:00:49.340296 11409 catalog_manager.cc:5671] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130). New cstate: current_term: 1 leader_uuid: "b85d150f168f406bb31ff44150b2b1a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260502 20:00:49.340513 11409 catalog_manager.cc:5763] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285) does not have the latest schema for tablet db76c47bb09042b5ac706c4b80fc3bb9 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]). Expected version 1 got 0
I20260502 20:00:49.342258 10800 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=33b0206efcd84429a0b2bc366a81e1fb]
I20260502 20:00:49.342293 10975 tablet_service.cc:1511] Processing CreateTablet for tablet 9df3ebd756b248d0b92bad3259e7a122 (DEFAULT_TABLE table=default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.342468 11252 tablet_service.cc:1511] Processing CreateTablet for tablet 9df3ebd756b248d0b92bad3259e7a122 (DEFAULT_TABLE table=default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.342566 10800 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 65) took 2166 ms. Trace:
I20260502 20:00:49.342624 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df3ebd756b248d0b92bad3259e7a122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.342727 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df3ebd756b248d0b92bad3259e7a122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.342617 10800 rpcz_store.cc:276] 0502 20:00:47.176011 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:48.100605 (+924594us) service_pool.cc:224] Handling call
0502 20:00:48.974504 (+873899us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:48.974890 (+ 386us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:49.164162 (+189272us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:49.164711 (+ 549us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:49.164713 (+ 2us) write_op.cc:454] Released schema lock
0502 20:00:49.164829 (+ 116us) catalog_manager.cc:2181] Rolling back HMS table creation
0502 20:00:49.342546 (+177717us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:49.164625 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica b470a66ad54f46b1b44a80dd1edf214e is not leader of this config: current role FOLLOWER)
0502 20:00:49.164637 (+ 12us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:49.164642 (+ 5us) write_op.cc:454] Released schema lock
0502 20:00:49.164665 (+ 23us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":106215,"Hive Metastore.run_cpu_time_us":358,"Hive Metastore.run_wall_time_us":260002,"child_traces":[["op",{}]]}
I20260502 20:00:49.344915 11828 tablet_bootstrap.cc:492] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:49.345631 11827 tablet_bootstrap.cc:492] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:49.345940 11828 tablet_bootstrap.cc:654] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.346670 11827 tablet_bootstrap.cc:654] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.351495 11827 tablet_bootstrap.cc:492] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:49.351598 11827 ts_tablet_manager.cc:1403] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260502 20:00:49.351675 11108 tablet_service.cc:1511] Processing CreateTablet for tablet 9df3ebd756b248d0b92bad3259e7a122 (DEFAULT_TABLE table=default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.351971 11108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df3ebd756b248d0b92bad3259e7a122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.352072 11827 raft_consensus.cc:359] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:49.352182 11827 raft_consensus.cc:385] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.352221 11827 raft_consensus.cc:740] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.352344 11827 consensus_queue.cc:260] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:49.354001 11827 ts_tablet_manager.cc:1434] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 20:00:49.354270 11828 tablet_bootstrap.cc:492] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:49.354386 11828 ts_tablet_manager.cc:1403] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260502 20:00:49.354692 11830 tablet_bootstrap.cc:492] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:49.354887 11828 raft_consensus.cc:359] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:49.355017 11828 raft_consensus.cc:385] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.355052 11828 raft_consensus.cc:740] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.355167 11828 consensus_queue.cc:260] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:49.355435 11828 ts_tablet_manager.cc:1434] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:49.355741 11830 tablet_bootstrap.cc:654] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
W20260502 20:00:49.359508 11409 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 2bf50334eb414d38ac3c09bcacb6d9bb (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 2bf50334eb414d38ac3c09bcacb6d9bb consensus state has no leader
I20260502 20:00:49.360601 11409 catalog_manager.cc:5763] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389) does not have the latest schema for tablet db76c47bb09042b5ac706c4b80fc3bb9 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]). Expected version 1 got 0
I20260502 20:00:49.360780 11409 catalog_manager.cc:5671] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 reported cstate change: term changed from 0 to 1, leader changed from <none> to ade741c4062940adb2223b55187ffe72 (127.10.27.131). New cstate: current_term: 1 leader_uuid: "ade741c4062940adb2223b55187ffe72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:49.360982 11409 catalog_manager.cc:5763] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389) does not have the latest schema for tablet 2bf50334eb414d38ac3c09bcacb6d9bb (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]). Expected version 1 got 0
I20260502 20:00:49.361914 11611 raft_consensus.cc:2804] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:49.362059 11611 raft_consensus.cc:697] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:49.362205 11611 consensus_queue.cc:237] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.363445 11830 tablet_bootstrap.cc:492] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:49.363554 11830 ts_tablet_manager.cc:1403] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260502 20:00:49.364130 11830 raft_consensus.cc:359] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:49.364251 11830 raft_consensus.cc:385] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.364295 11830 raft_consensus.cc:740] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.364405 11830 consensus_queue.cc:260] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:49.364679 11830 ts_tablet_manager.cc:1434] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:49.371671 10995 raft_consensus.cc:3060] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.372718 10995 raft_consensus.cc:1275] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Refusing update from remote peer b85d150f168f406bb31ff44150b2b1a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 20:00:49.373214 11611 consensus_queue.cc:1048] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:49.374202 11272 raft_consensus.cc:1275] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Refusing update from remote peer b85d150f168f406bb31ff44150b2b1a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 20:00:49.374653 11611 consensus_queue.cc:1048] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:49.378821 11541 mvcc.cc:204] Tried to move back new op lower bound from 7281672394218881024 to 7281672393567158272. Current Snapshot: MvccSnapshot[applied={T|T < 7281672394218881024}]
I20260502 20:00:49.379019 11814 tablet.cc:1724] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:49.379683 11409 catalog_manager.cc:5763] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793) does not have the latest schema for tablet 2bf50334eb414d38ac3c09bcacb6d9bb (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]). Expected version 1 got 0
I20260502 20:00:49.379794 11409 catalog_manager.cc:5763] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793) does not have the latest schema for tablet db76c47bb09042b5ac706c4b80fc3bb9 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]). Expected version 1 got 0
I20260502 20:00:49.381603 11815 tablet.cc:1724] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:49.382854 11538 mvcc.cc:204] Tried to move back new op lower bound from 7281672394218881024 to 7281672393567158272. Current Snapshot: MvccSnapshot[applied={T|T < 7281672394218881024}]
I20260502 20:00:49.382958 11409 catalog_manager.cc:5671] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130). New cstate: current_term: 1 leader_uuid: "b85d150f168f406bb31ff44150b2b1a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260502 20:00:49.387522 11405 catalog_manager.cc:3502] renamed table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b] in HMS: new name default.table_41eddb5da0424c5ea3a77e1f59af0916
I20260502 20:00:49.399883 11409 catalog_manager.cc:5763] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389) does not have the latest schema for tablet db76c47bb09042b5ac706c4b80fc3bb9 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]). Expected version 1 got 0
I20260502 20:00:49.401274 11409 catalog_manager.cc:5763] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793) does not have the latest schema for tablet db76c47bb09042b5ac706c4b80fc3bb9 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]). Expected version 1 got 0
I20260502 20:00:49.401846 11409 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38448:
name: "default.Table_6b8d71e2af3a4d8ca933ba45c43b464e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:49.407076 11537 mvcc.cc:204] Tried to move back new op lower bound from 7281672394218881024 to 7281672393567158272. Current Snapshot: MvccSnapshot[applied={T|T < 7281672394218881024}]
I20260502 20:00:49.414137 11413 catalog_manager.cc:2174] created HMS catalog entry for table [id=4496e3f1cb2a4e2ea1b952e15cfaca02]
I20260502 20:00:49.415015 11857 tablet.cc:1724] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:49.417227 11131 raft_consensus.cc:1275] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Refusing update from remote peer ade741c4062940adb2223b55187ffe72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 20:00:49.417742 11504 consensus_queue.cc:1048] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:49.418323 11536 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:49.418412 11536 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.418779 11536 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:49.419606 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5837b307bb43258aa75c9a947dd5c6" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:49.419751 11273 raft_consensus.cc:2468] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:49.421561 10930 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:49.421828 11536 raft_consensus.cc:2804] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:49.421890 11536 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:49.421931 11536 raft_consensus.cc:3060] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.423014 11536 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.423456 11536 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:49.424453 10995 raft_consensus.cc:1275] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Refusing update from remote peer ade741c4062940adb2223b55187ffe72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 20:00:49.426760 11504 consensus_queue.cc:1048] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:49.427680 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5837b307bb43258aa75c9a947dd5c6" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:49.427811 11273 raft_consensus.cc:3060] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.428908 11273 raft_consensus.cc:2468] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:49.431277 10930 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:49.431536 11505 raft_consensus.cc:2804] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:49.431629 11505 raft_consensus.cc:697] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:49.431774 11505 consensus_queue.cc:237] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.433379 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5837b307bb43258aa75c9a947dd5c6" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:49.433522 11132 raft_consensus.cc:2468] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:49.436112 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5837b307bb43258aa75c9a947dd5c6" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:49.436244 11130 raft_consensus.cc:3060] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.437397 11130 raft_consensus.cc:2468] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:49.448073 11413 catalog_manager.cc:5763] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793) does not have the latest schema for tablet db76c47bb09042b5ac706c4b80fc3bb9 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]). Expected version 1 got 0
I20260502 20:00:49.449376 11413 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38448:
table { table_name: "default.Table_115178421c134252971c7a71b1134464" } new_table_name: "default.Table_9b0b95067a6444d783041819f979eb27" modify_external_catalogs: true
I20260502 20:00:49.454625 11815 tablet.cc:1724] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:49.457899 11857 tablet.cc:1724] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:49.468216 11814 tablet.cc:1724] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 20:00:49.469858 11108 tablet_service.cc:1511] Processing CreateTablet for tablet c8e6be4db78c4544bca924bcbff3a4b9 (DEFAULT_TABLE table=default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.470093 11108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8e6be4db78c4544bca924bcbff3a4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.471764 11830 tablet_bootstrap.cc:492] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:49.473131 11830 tablet_bootstrap.cc:654] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.473251 11252 tablet_service.cc:1511] Processing CreateTablet for tablet c8e6be4db78c4544bca924bcbff3a4b9 (DEFAULT_TABLE table=default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.473510 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8e6be4db78c4544bca924bcbff3a4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.474087 10975 tablet_service.cc:1511] Processing CreateTablet for tablet c8e6be4db78c4544bca924bcbff3a4b9 (DEFAULT_TABLE table=default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.474355 11830 tablet_bootstrap.cc:492] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:49.474366 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8e6be4db78c4544bca924bcbff3a4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.474434 11830 ts_tablet_manager.cc:1403] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:49.474902 11830 raft_consensus.cc:359] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.475044 11830 raft_consensus.cc:385] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.475077 11830 raft_consensus.cc:740] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.475183 11830 consensus_queue.cc:260] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.475481 11830 ts_tablet_manager.cc:1434] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:49.475627 11827 tablet_bootstrap.cc:492] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:49.476500 11828 tablet_bootstrap.cc:492] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:49.476672 11827 tablet_bootstrap.cc:654] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.477579 11828 tablet_bootstrap.cc:654] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.479542 11828 tablet_bootstrap.cc:492] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:49.479630 11828 ts_tablet_manager.cc:1403] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:49.480094 11828 raft_consensus.cc:359] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.480190 11828 raft_consensus.cc:385] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.480233 11828 raft_consensus.cc:740] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.480356 11828 consensus_queue.cc:260] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.480690 11828 ts_tablet_manager.cc:1434] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:49.480958 11524 raft_consensus.cc:493] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:49.481031 11524 raft_consensus.cc:515] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.481395 11524 leader_election.cc:290] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:49.482187 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6be4db78c4544bca924bcbff3a4b9" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:49.482319 11131 raft_consensus.cc:2468] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:49.483017 10933 leader_election.cc:304] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:49.483193 11536 raft_consensus.cc:2804] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:49.483251 11536 raft_consensus.cc:493] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:49.483289 11536 raft_consensus.cc:3060] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.484268 11536 raft_consensus.cc:515] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.484588 11536 leader_election.cc:290] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:49.485250 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6be4db78c4544bca924bcbff3a4b9" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:49.485366 11131 raft_consensus.cc:3060] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.486284 11131 raft_consensus.cc:2468] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:49.486589 10933 leader_election.cc:304] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:49.486866 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6be4db78c4544bca924bcbff3a4b9" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:49.487269 11536 raft_consensus.cc:2804] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:49.487358 11536 raft_consensus.cc:697] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
W20260502 20:00:49.487381 10930 leader_election.cc:343] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260502 20:00:49.487486 11536 consensus_queue.cc:237] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.487879 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6be4db78c4544bca924bcbff3a4b9" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
W20260502 20:00:49.488230 10930 leader_election.cc:343] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260502 20:00:49.492621 10806 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=7d9fa0bb8a9b4877b6bbbac853119f8d]
I20260502 20:00:49.492996 10806 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:56168 (request call id 66) took 2257 ms. Trace:
I20260502 20:00:49.493095 10806 rpcz_store.cc:276] 0502 20:00:47.235154 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 20:00:48.105531 (+870377us) service_pool.cc:224] Handling call
0502 20:00:48.976208 (+870677us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 20:00:48.976597 (+ 389us) catalog_manager.cc:2147] Created new table and tablet info
0502 20:00:49.271186 (+294589us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 20:00:49.271740 (+ 554us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:49.271742 (+ 2us) write_op.cc:454] Released schema lock
0502 20:00:49.271858 (+ 116us) catalog_manager.cc:2181] Rolling back HMS table creation
0502 20:00:49.492964 (+221106us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 20:00:49.271690 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica b470a66ad54f46b1b44a80dd1edf214e is not leader of this config: current role FOLLOWER)
0502 20:00:49.271699 (+ 9us) write_op.cc:489] Releasing partition, row and schema locks
0502 20:00:49.271704 (+ 5us) write_op.cc:454] Released schema lock
0502 20:00:49.271707 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":257573,"Hive Metastore.run_cpu_time_us":335,"Hive Metastore.run_wall_time_us":257273,"child_traces":[["op",{}]]}
I20260502 20:00:49.502358 11827 tablet_bootstrap.cc:492] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:49.502494 11827 ts_tablet_manager.cc:1403] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.001s
I20260502 20:00:49.503106 11827 raft_consensus.cc:359] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.504637 11827 raft_consensus.cc:385] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.504777 11827 raft_consensus.cc:740] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.505152 11827 consensus_queue.cc:260] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.507844 11827 ts_tablet_manager.cc:1434] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260502 20:00:49.533538 11406 catalog_manager.cc:3502] renamed table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464] in HMS: new name default.table_fd2a46a7a29e42429193d222c7c5037f
I20260502 20:00:49.582662 11411 catalog_manager.cc:2174] created HMS catalog entry for table [id=f1790d56aefb46c69a6fbb4522d0af3b]
I20260502 20:00:49.583724 11504 raft_consensus.cc:493] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:49.583847 11504 raft_consensus.cc:515] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.584319 11504 leader_election.cc:290] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:49.586232 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6be4db78c4544bca924bcbff3a4b9" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:49.586599 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6be4db78c4544bca924bcbff3a4b9" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:49.586783 11131 raft_consensus.cc:2393] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ade741c4062940adb2223b55187ffe72 in current term 1: Already voted for candidate 858db0bc9f07476e9d1540f2b095414f in this term.
I20260502 20:00:49.591456 11206 leader_election.cc:304] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:00:49.591740 11504 raft_consensus.cc:3060] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.592877 11504 raft_consensus.cc:2749] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 20:00:49.597002 11411 catalog_manager.cc:5763] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285) does not have the latest schema for tablet 2bf50334eb414d38ac3c09bcacb6d9bb (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]). Expected version 1 got 0
I20260502 20:00:49.607064 11411 catalog_manager.cc:5671] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to 858db0bc9f07476e9d1540f2b095414f (127.10.27.129). New cstate: current_term: 1 leader_uuid: "858db0bc9f07476e9d1540f2b095414f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:49.607385 11411 catalog_manager.cc:5763] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793) does not have the latest schema for tablet 2bf50334eb414d38ac3c09bcacb6d9bb (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]). Expected version 1 got 0
I20260502 20:00:49.608103 11108 tablet_service.cc:1511] Processing CreateTablet for tablet aa0b66d220bf46fe853b2f03778b2096 (DEFAULT_TABLE table=default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.608426 11108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0b66d220bf46fe853b2f03778b2096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.609205 10975 tablet_service.cc:1511] Processing CreateTablet for tablet aa0b66d220bf46fe853b2f03778b2096 (DEFAULT_TABLE table=default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.609472 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0b66d220bf46fe853b2f03778b2096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.611497 11828 tablet_bootstrap.cc:492] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:49.611598 11830 tablet_bootstrap.cc:492] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:49.612547 11828 tablet_bootstrap.cc:654] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.612546 11830 tablet_bootstrap.cc:654] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.613813 11252 tablet_service.cc:1511] Processing CreateTablet for tablet aa0b66d220bf46fe853b2f03778b2096 (DEFAULT_TABLE table=default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.614100 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0b66d220bf46fe853b2f03778b2096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.616587 11827 tablet_bootstrap.cc:492] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:49.617578 11827 tablet_bootstrap.cc:654] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.620868 11611 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:49.621002 11611 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:49.621426 11611 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:49.621783 11411 catalog_manager.cc:5763] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389) does not have the latest schema for tablet 2bf50334eb414d38ac3c09bcacb6d9bb (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]). Expected version 1 got 0
I20260502 20:00:49.623791 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df3ebd756b248d0b92bad3259e7a122" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:49.623961 10995 raft_consensus.cc:2468] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:49.624667 11065 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:49.625252 11611 raft_consensus.cc:2804] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:49.625325 11611 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:49.625370 11611 raft_consensus.cc:3060] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.626446 11611 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:49.626885 11611 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:49.627823 11828 tablet_bootstrap.cc:492] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:49.627945 11828 ts_tablet_manager.cc:1403] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260502 20:00:49.628281 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df3ebd756b248d0b92bad3259e7a122" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:49.628436 11272 raft_consensus.cc:2468] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:49.628563 11828 raft_consensus.cc:359] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.628680 11828 raft_consensus.cc:385] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.628731 11828 raft_consensus.cc:740] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.628886 11828 consensus_queue.cc:260] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.629189 11828 ts_tablet_manager.cc:1434] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:49.629446 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df3ebd756b248d0b92bad3259e7a122" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:49.629566 11273 raft_consensus.cc:3060] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.630678 11273 raft_consensus.cc:2468] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:49.628664 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df3ebd756b248d0b92bad3259e7a122" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:49.631075 10995 raft_consensus.cc:3060] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.632064 10995 raft_consensus.cc:2468] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:49.632877 11827 tablet_bootstrap.cc:492] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:49.632978 11827 ts_tablet_manager.cc:1403] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260502 20:00:49.633538 11827 raft_consensus.cc:359] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.633638 11827 raft_consensus.cc:385] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.633668 11827 raft_consensus.cc:740] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.633787 11827 consensus_queue.cc:260] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.634083 11827 ts_tablet_manager.cc:1434] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:00:49.635589 11065 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:49.643630 11830 tablet_bootstrap.cc:492] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:49.643774 11830 ts_tablet_manager.cc:1403] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20260502 20:00:49.644369 11830 raft_consensus.cc:359] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.644493 11830 raft_consensus.cc:385] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.644534 11830 raft_consensus.cc:740] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.645488 11830 consensus_queue.cc:260] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.645925 11562 raft_consensus.cc:2804] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:49.646014 11562 raft_consensus.cc:697] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:49.646136 11562 consensus_queue.cc:237] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:49.646134 11411 catalog_manager.cc:5671] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f reported cstate change: term changed from 0 to 1, leader changed from <none> to 858db0bc9f07476e9d1540f2b095414f (127.10.27.129). New cstate: current_term: 1 leader_uuid: "858db0bc9f07476e9d1540f2b095414f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:49.655038 11830 ts_tablet_manager.cc:1434] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260502 20:00:49.656886 11411 catalog_manager.cc:5671] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130). New cstate: current_term: 1 leader_uuid: "b85d150f168f406bb31ff44150b2b1a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260502 20:00:49.664477 11411 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38448:
name: "default.Table_c1f90f27e25c436bb0c43af980cece1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:49.676205 11408 catalog_manager.cc:3502] renamed table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86] in HMS: new name default.table_9fb8cc097c6f4bd48e5f41dd70218be1
I20260502 20:00:49.685423 11524 consensus_queue.cc:1048] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:49.689886 11524 consensus_queue.cc:1048] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:49.709321 11410 catalog_manager.cc:2174] created HMS catalog entry for table [id=c3e6566d144540e9af6052d08b2c4dee]
I20260502 20:00:49.728608 11108 tablet_service.cc:1511] Processing CreateTablet for tablet 35074187f6b140ea888ef0f2a692bb93 (DEFAULT_TABLE table=default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.728958 11108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35074187f6b140ea888ef0f2a692bb93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.729089 11252 tablet_service.cc:1511] Processing CreateTablet for tablet 35074187f6b140ea888ef0f2a692bb93 (DEFAULT_TABLE table=default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.729391 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35074187f6b140ea888ef0f2a692bb93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.731385 11830 tablet_bootstrap.cc:492] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:49.731668 11827 tablet_bootstrap.cc:492] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:49.732450 11830 tablet_bootstrap.cc:654] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.732831 11827 tablet_bootstrap.cc:654] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.734143 10975 tablet_service.cc:1511] Processing CreateTablet for tablet 35074187f6b140ea888ef0f2a692bb93 (DEFAULT_TABLE table=default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:49.734421 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35074187f6b140ea888ef0f2a692bb93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:49.736435 11828 tablet_bootstrap.cc:492] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:49.737444 11828 tablet_bootstrap.cc:654] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:49.719993 11410 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38448:
name: "default.Table_2eef3c375d5248539d96b67ea8bbc2be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:49.739910 11827 tablet_bootstrap.cc:492] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:49.740046 11827 ts_tablet_manager.cc:1403] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260502 20:00:49.740625 11827 raft_consensus.cc:359] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.740752 11827 raft_consensus.cc:385] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.740794 11827 raft_consensus.cc:740] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.740935 11827 consensus_queue.cc:260] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.741298 11827 ts_tablet_manager.cc:1434] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:00:49.744541 11830 tablet_bootstrap.cc:492] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:49.744649 11830 ts_tablet_manager.cc:1403] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260502 20:00:49.746232 11830 raft_consensus.cc:359] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.746346 11830 raft_consensus.cc:385] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.746377 11830 raft_consensus.cc:740] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.746495 11830 consensus_queue.cc:260] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.747658 11830 ts_tablet_manager.cc:1434] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 20:00:49.767637 11828 tablet_bootstrap.cc:492] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:49.767803 11828 ts_tablet_manager.cc:1403] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20260502 20:00:49.768540 11828 raft_consensus.cc:359] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.768697 11828 raft_consensus.cc:385] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:49.768741 11828 raft_consensus.cc:740] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:49.768890 11828 consensus_queue.cc:260] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.769243 11828 ts_tablet_manager.cc:1434] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:49.795871 11412 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]
F20260502 20:00:49.806396 11467 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 26, previous 26; dumping first 3 out of 13 received events: NotificationEvent(eventId=25, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_b19cf190454d42ff99d3fcab96f783b1, message={"server":"","servicePrincipal":"","db":"default","table":"table_b19cf190454d42ff99d3fcab96f783b1","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_b19cf190454d42ff99d3fcab96f783b1\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752048},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b19cf190454d42ff99d3fcab96f783b1\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b19cf190454d42ff99d3fcab96f783b1\",\"kudu.table_id\":\"33b0206efcd84429a0b2bc366a81e1fb\",\"transient_lastDdlTime\":\"1777752048\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=ALTER_TABLE, dbName=default, tableName=table_b9b31b57bb724b299b6000678ee9e5a4, message={"server":"","servicePrincipal":"","db":"default","table":"table_24faf39307584530a038ed30536bd4c2","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_24faf39307584530a038ed30536bd4c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_24faf39307584530a038ed30536bd4c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_24faf39307584530a038ed30536bd4c2\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_b9b31b57bb724b299b6000678ee9e5a4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b9b31b57bb724b299b6000678ee9e5a4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b9b31b57bb724b299b6000678ee9e5a4\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1777752049}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_8ad450efb0df42d2bb35c3f8d3e0b78e, message={"server":"","servicePrincipal":"","db":"default","table":"table_8ad450efb0df42d2bb35c3f8d3e0b78e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752049},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_8ad450efb0df42d2bb35c3f8d3e0b78e\",\"kudu.table_id\":\"7d9fa0bb8a9b4877b6bbbac853119f8d\",\"transient_lastDdlTime\":\"1777752049\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260502 20:00:49.813858 11611 consensus_queue.cc:1048] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:49.821110 11611 consensus_queue.cc:1048] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
@ 0x7eff1a7d1dcd google::LogMessage::Fail() at ??:0
I20260502 20:00:49.833906 11524 consensus_queue.cc:1048] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
@ 0x7eff1a7d5b93 google::LogMessage::SendToLog() at ??:0
I20260502 20:00:49.839298 11505 consensus_queue.cc:1048] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
@ 0x7eff1a7d17cc google::LogMessage::Flush() at ??:0
@ 0x7eff1a7d1a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7eff1fd45433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 20:00:49.856673 11611 raft_consensus.cc:493] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:49.856848 11611 raft_consensus.cc:515] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
@ 0x7eff1fd4434a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 20:00:49.857429 11611 leader_election.cc:290] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:49.859686 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b66d220bf46fe853b2f03778b2096" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:49.859889 10995 raft_consensus.cc:2468] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:49.860369 11065 leader_election.cc:304] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:49.860857 11611 raft_consensus.cc:2804] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:49.860916 11611 raft_consensus.cc:493] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:49.860888 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b66d220bf46fe853b2f03778b2096" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:49.860953 11611 raft_consensus.cc:3060] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.861049 11273 raft_consensus.cc:2468] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
@ 0x7eff1fd43aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 20:00:49.862596 11611 raft_consensus.cc:515] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.863886 11611 leader_election.cc:290] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:49.864830 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b66d220bf46fe853b2f03778b2096" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:49.864997 10995 raft_consensus.cc:3060] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
@ 0x7eff1fd491b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260502 20:00:49.866400 10995 raft_consensus.cc:2468] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
@ 0x555b7a968244 std::function<>::operator()() at ??:0
I20260502 20:00:49.867118 11065 leader_election.cc:304] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:49.867111 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b66d220bf46fe853b2f03778b2096" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:49.867251 11273 raft_consensus.cc:3060] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.867321 11611 raft_consensus.cc:2804] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:49.867404 11611 raft_consensus.cc:697] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:49.867556 11611 consensus_queue.cc:237] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.868291 11273 raft_consensus.cc:2468] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
@ 0x7eff1bcd67ea kudu::Thread::SuperviseThread() at ??:0
@ 0x7eff1c61a6db start_thread at ??:0
@ 0x7eff1998861f clone at ??:0
I20260502 20:00:49.888703 11505 consensus_queue.cc:1048] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:49.894295 11524 consensus_queue.cc:1048] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:49.927610 11562 raft_consensus.cc:493] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:49.927772 11562 raft_consensus.cc:515] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.928231 11562 leader_election.cc:290] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:49.928815 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35074187f6b140ea888ef0f2a692bb93" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:49.928817 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35074187f6b140ea888ef0f2a692bb93" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:49.928961 10995 raft_consensus.cc:2468] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:49.928985 11273 raft_consensus.cc:2468] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:49.929361 11065 leader_election.cc:304] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:49.929569 11562 raft_consensus.cc:2804] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:49.929628 11562 raft_consensus.cc:493] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:49.929662 11562 raft_consensus.cc:3060] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.930719 11562 raft_consensus.cc:515] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:49.931114 11562 leader_election.cc:290] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:49.931573 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35074187f6b140ea888ef0f2a692bb93" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:49.931579 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35074187f6b140ea888ef0f2a692bb93" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:49.931691 10995 raft_consensus.cc:3060] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.931699 11273 raft_consensus.cc:3060] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:49.932677 10995 raft_consensus.cc:2468] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:49.932724 11273 raft_consensus.cc:2468] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:49.933079 11065 leader_election.cc:304] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:49.933303 11562 raft_consensus.cc:2804] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:49.933400 11562 raft_consensus.cc:697] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:49.933569 11562 consensus_queue.cc:237] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
W20260502 20:00:50.086500 11327 connection.cc:570] client connection to 127.10.27.190:46101 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:50.086793 11327 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.27.190:46101)
W20260502 20:00:50.087889 11327 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.10.27.190:46101)
W20260502 20:00:50.088131 11894 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 20:00:50.087092 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.10.27.190:46101 (local address 127.10.27.129:54001)
0502 20:00:50.087508 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0502 20:00:50.087559 (+ 51us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":79,"threads_started":1}
W20260502 20:00:50.088164 11327 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.10.27.190:46101)
W20260502 20:00:50.088337 11895 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 20:00:50.087252 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.10.27.190:46101 (local address 127.10.27.131:48145)
0502 20:00:50.087862 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0502 20:00:50.087907 (+ 45us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":57,"threads_started":1}
W20260502 20:00:50.088456 11327 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.10.27.190:46101)
I20260502 20:00:50.126163 11562 consensus_queue.cc:1048] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:50.129738 11562 consensus_queue.cc:1048] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:50.235961 11900 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 38315e4f56484666b5e54afad02498ec)
I20260502 20:00:50.236135 11900 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:50.236704 11900 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:00:50.237497 10791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260502 20:00:50.238392 10791 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:00:50.238693 11905 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 38315e4f56484666b5e54afad02498ec)
I20260502 20:00:50.238807 11905 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:50.241199 11905 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
I20260502 20:00:50.241242 10816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ef9294b460014382a2a594c77f8900d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 106 } } ignore_live_leader: false dest_uuid: "b470a66ad54f46b1b44a80dd1edf214e" is_pre_election: true
I20260502 20:00:50.241405 10816 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9294b460014382a2a594c77f8900d4 in term 4.
W20260502 20:00:50.241611 11700 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:00:50.241761 11701 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4; no voters:
I20260502 20:00:50.242033 11905 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260502 20:00:50.242108 11905 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 38315e4f56484666b5e54afad02498ec)
I20260502 20:00:50.242161 11905 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 4 FOLLOWER]: Advancing to term 5
I20260502 20:00:50.242314 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b470a66ad54f46b1b44a80dd1edf214e" candidate_term: 5 candidate_status { last_received { term: 4 index: 106 } } ignore_live_leader: false dest_uuid: "ef9294b460014382a2a594c77f8900d4" is_pre_election: true
W20260502 20:00:50.242801 11700 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:00:50.243561 11905 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:50.243887 11727 raft_consensus.cc:2393] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b470a66ad54f46b1b44a80dd1edf214e in current term 5: Already voted for candidate ef9294b460014382a2a594c77f8900d4 in this term.
I20260502 20:00:50.244074 11905 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 5 election: Requested vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
I20260502 20:00:50.244508 10816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ef9294b460014382a2a594c77f8900d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 106 } } ignore_live_leader: false dest_uuid: "b470a66ad54f46b1b44a80dd1edf214e"
I20260502 20:00:50.244671 10816 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 4 FOLLOWER]: Advancing to term 5
I20260502 20:00:50.244737 10790 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:00:50.245862 10816 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9294b460014382a2a594c77f8900d4 in term 5.
I20260502 20:00:50.246049 11900 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260502 20:00:50.246361 11701 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4; no voters:
I20260502 20:00:50.246569 11905 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260502 20:00:50.246825 11905 raft_consensus.cc:697] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 5 LEADER]: Becoming Leader. State: Replica: ef9294b460014382a2a594c77f8900d4, State: Running, Role: LEADER
W20260502 20:00:50.247210 11700 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:00:50.247227 11905 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 4.106, Last appended by leader: 106, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:50.248281 11908 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef9294b460014382a2a594c77f8900d4. Latest consensus state: current_term: 5 leader_uuid: "ef9294b460014382a2a594c77f8900d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:50.248368 11908 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:50.248697 11909 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 20:00:50.250428 11909 catalog_manager.cc:679] Loaded metadata for table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc]
I20260502 20:00:50.250806 11909 catalog_manager.cc:679] Loaded metadata for table default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]
I20260502 20:00:50.251087 11909 catalog_manager.cc:679] Loaded metadata for table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]
I20260502 20:00:50.251338 11909 catalog_manager.cc:679] Loaded metadata for table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]
I20260502 20:00:50.251610 11909 catalog_manager.cc:679] Loaded metadata for table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]
I20260502 20:00:50.251850 11909 catalog_manager.cc:679] Loaded metadata for table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]
I20260502 20:00:50.252099 11909 catalog_manager.cc:679] Loaded metadata for table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]
I20260502 20:00:50.252413 11909 catalog_manager.cc:679] Loaded metadata for table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]
I20260502 20:00:50.252719 11909 catalog_manager.cc:679] Loaded metadata for table default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150]
I20260502 20:00:50.253196 11909 catalog_manager.cc:679] Loaded metadata for table default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]
I20260502 20:00:50.253489 11909 catalog_manager.cc:679] Loaded metadata for table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f]
I20260502 20:00:50.253723 11909 catalog_manager.cc:679] Loaded metadata for table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2]
I20260502 20:00:50.253945 11909 catalog_manager.cc:679] Loaded metadata for table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63]
I20260502 20:00:50.254263 11909 catalog_manager.cc:679] Loaded metadata for table default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b]
I20260502 20:00:50.254328 11562 consensus_queue.cc:1048] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:50.254794 11909 catalog_manager.cc:679] Loaded metadata for table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]
I20260502 20:00:50.257573 11909 tablet_loader.cc:96] loaded metadata for tablet 0ea263d32fd2405985d4514c2ff02a39 (table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f])
I20260502 20:00:50.258009 11909 tablet_loader.cc:96] loaded metadata for tablet 11548942c58f4c05bad32038a55b8f66 (table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63])
I20260502 20:00:50.258390 11909 tablet_loader.cc:96] loaded metadata for tablet 2bf50334eb414d38ac3c09bcacb6d9bb (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760])
I20260502 20:00:50.258615 11909 tablet_loader.cc:96] loaded metadata for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b])
I20260502 20:00:50.258828 11909 tablet_loader.cc:96] loaded metadata for tablet 35074187f6b140ea888ef0f2a692bb93 (table default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee])
I20260502 20:00:50.260380 11909 tablet_loader.cc:96] loaded metadata for tablet 9df3ebd756b248d0b92bad3259e7a122 (table default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150])
I20260502 20:00:50.260715 11909 tablet_loader.cc:96] loaded metadata for tablet aa0b66d220bf46fe853b2f03778b2096 (table default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b])
I20260502 20:00:50.260924 11909 tablet_loader.cc:96] loaded metadata for tablet af5837b307bb43258aa75c9a947dd5c6 (table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b])
I20260502 20:00:50.261137 11909 tablet_loader.cc:96] loaded metadata for tablet b3f6a9613e594f12b0e518d0b9d9e7ed (table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064])
I20260502 20:00:50.261672 11909 tablet_loader.cc:96] loaded metadata for tablet c65cb9d41234432c99c4dfb7240ba0ad (table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86])
I20260502 20:00:50.261894 11909 tablet_loader.cc:96] loaded metadata for tablet c671b41464b74cd1bfcec7eb52043bd3 (table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f])
I20260502 20:00:50.262102 11909 tablet_loader.cc:96] loaded metadata for tablet c8e6be4db78c4544bca924bcbff3a4b9 (table default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02])
I20260502 20:00:50.262506 11909 tablet_loader.cc:96] loaded metadata for tablet db76c47bb09042b5ac706c4b80fc3bb9 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464])
I20260502 20:00:50.262526 11612 consensus_queue.cc:1048] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:50.262732 11909 tablet_loader.cc:96] loaded metadata for tablet e43e158d448442d3811dbdfe82db47ca (table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2])
I20260502 20:00:50.263098 11909 tablet_loader.cc:96] loaded metadata for tablet eb15659f8f6549d49f44639345471f6e (table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc])
I20260502 20:00:50.263372 11909 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 20:00:50.266412 11909 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:00:50.266503 11909 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 20:00:50.268211 11909 catalog_manager.cc:1514] Loading token signing keys...
I20260502 20:00:50.268685 11909 catalog_manager.cc:6055] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Loaded TSK: 0
I20260502 20:00:50.269512 11909 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 20:00:50.270185 11909 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 20:00:50.270821 11909 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 24
I20260502 20:00:50.286300 11714 master_service.cc:954] ReplaceTablet: received request to replace tablet c65cb9d41234432c99c4dfb7240ba0ad from {username='slave'} at 127.0.0.1:34860
I20260502 20:00:50.286583 11715 master_service.cc:954] ReplaceTablet: received request to replace tablet 2bf50334eb414d38ac3c09bcacb6d9bb from {username='slave'} at 127.0.0.1:34860
I20260502 20:00:50.287051 11712 master_service.cc:954] ReplaceTablet: received request to replace tablet c671b41464b74cd1bfcec7eb52043bd3 from {username='slave'} at 127.0.0.1:34860
I20260502 20:00:50.287366 11713 master_service.cc:954] ReplaceTablet: received request to replace tablet c65cb9d41234432c99c4dfb7240ba0ad from {username='slave'} at 127.0.0.1:34860
I20260502 20:00:50.286386 11717 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34860:
name: "default.Table_89091fe7dff644288a504e28216d5d69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:50.286198 11708 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34860:
name: "default.Table_e36b131ff7344eba80b753a6b7ff4c11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:50.286509 11716 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34860:
name: "default.Table_89adbf9d323b449db6deb0fa830829bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:50.285960 11710 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34860:
name: "default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:50.286177 11711 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34860:
name: "default.Table_bcbf40331f9a4354927f24a56b69f1f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:50.285912 11709 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34860:
name: "default.Table_b19cf190454d42ff99d3fcab96f783b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:50.291019 10816 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Refusing update from remote peer ef9294b460014382a2a594c77f8900d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 106. Preceding OpId from leader: term: 5 index: 108. (index mismatch)
I20260502 20:00:50.291821 11905 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260502 20:00:50.293507 11900 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef9294b460014382a2a594c77f8900d4. Latest consensus state: current_term: 5 leader_uuid: "ef9294b460014382a2a594c77f8900d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:50.293628 11900 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:50.294999 11905 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "ef9294b460014382a2a594c77f8900d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:50.295126 11905 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: LEADER
W20260502 20:00:50.295318 11700 consensus_peers.cc:597] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 -> Peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Couldn't send request to peer 38315e4f56484666b5e54afad02498ec. Status: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260502 20:00:50.295626 11781 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 26, previous 26; dumping first 3 out of 13 received events: NotificationEvent(eventId=25, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_b19cf190454d42ff99d3fcab96f783b1, message={"server":"","servicePrincipal":"","db":"default","table":"table_b19cf190454d42ff99d3fcab96f783b1","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_b19cf190454d42ff99d3fcab96f783b1\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752048},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b19cf190454d42ff99d3fcab96f783b1\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b19cf190454d42ff99d3fcab96f783b1\",\"kudu.table_id\":\"33b0206efcd84429a0b2bc366a81e1fb\",\"transient_lastDdlTime\":\"1777752048\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=ALTER_TABLE, dbName=default, tableName=table_b9b31b57bb724b299b6000678ee9e5a4, message={"server":"","servicePrincipal":"","db":"default","table":"table_24faf39307584530a038ed30536bd4c2","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_24faf39307584530a038ed30536bd4c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_24faf39307584530a038ed30536bd4c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_24faf39307584530a038ed30536bd4c2\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_b9b31b57bb724b299b6000678ee9e5a4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b9b31b57bb724b299b6000678ee9e5a4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b9b31b57bb724b299b6000678ee9e5a4\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1777752049}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_8ad450efb0df42d2bb35c3f8d3e0b78e, message={"server":"","servicePrincipal":"","db":"default","table":"table_8ad450efb0df42d2bb35c3f8d3e0b78e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752049},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_8ad450efb0df42d2bb35c3f8d3e0b78e\",\"kudu.table_id\":\"7d9fa0bb8a9b4877b6bbbac853119f8d\",\"transient_lastDdlTime\":\"1777752049\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260502 20:00:50.296154 11714 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet c65cb9d41234432c99c4dfb7240ba0ad
I20260502 20:00:50.297528 11714 catalog_manager.cc:6741] ReplaceTablet: tablet c65cb9d41234432c99c4dfb7240ba0ad deleted and replaced by tablet 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:00:50.297749 11714 master_service.cc:954] ReplaceTablet: received request to replace tablet eb15659f8f6549d49f44639345471f6e from {username='slave'} at 127.0.0.1:34860
I20260502 20:00:50.299000 11900 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "ef9294b460014382a2a594c77f8900d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:50.299117 11900 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:50.299377 11712 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet c671b41464b74cd1bfcec7eb52043bd3
I20260502 20:00:50.299654 11712 catalog_manager.cc:6741] ReplaceTablet: tablet c671b41464b74cd1bfcec7eb52043bd3 deleted and replaced by tablet 3ab25bb12883434cace35c4170dbc2e5
I20260502 20:00:50.299907 11712 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34860:
table { table_name: "default.Table_41826ad67ed540e0a427cd0347407518" } modify_external_catalogs: true
I20260502 20:00:50.299939 11713 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34860:
table { table_name: "default.Table_35a03681af3042babb0e601163d9fe20" } modify_external_catalogs: true
I20260502 20:00:50.300058 11713 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34860:
table { table_name: "default.Table_35a03681af3042babb0e601163d9fe20" } modify_external_catalogs: true
I20260502 20:00:50.300041 11712 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34860:
table { table_name: "default.Table_41826ad67ed540e0a427cd0347407518" } modify_external_catalogs: true
W20260502 20:00:50.300508 10790 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 34eaaaf6417a4e80b3409ea1fdcac25b consensus state has no leader
@ 0x7f4212d31dcd google::LogMessage::Fail() at ??:0
I20260502 20:00:50.303321 11714 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet eb15659f8f6549d49f44639345471f6e
I20260502 20:00:50.303622 11714 catalog_manager.cc:6741] ReplaceTablet: tablet eb15659f8f6549d49f44639345471f6e deleted and replaced by tablet f6de313115d04ebebe7c481d640c260e
I20260502 20:00:50.303807 11714 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34860:
table { table_name: "default.Table_8f233da2ffa04623bc614dc8d7d8e51c" } modify_external_catalogs: true
I20260502 20:00:50.303926 11714 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34860:
table { table_name: "default.Table_8f233da2ffa04623bc614dc8d7d8e51c" } modify_external_catalogs: true
@ 0x7f4212d35b93 google::LogMessage::SendToLog() at ??:0
I20260502 20:00:50.304507 11715 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet 2bf50334eb414d38ac3c09bcacb6d9bb
I20260502 20:00:50.304786 11715 catalog_manager.cc:6741] ReplaceTablet: tablet 2bf50334eb414d38ac3c09bcacb6d9bb deleted and replaced by tablet a18f3a9b1f514513a807d0a919db1f20
I20260502 20:00:50.304961 11715 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34860:
table { table_name: "default.Table_ac5362bfe46a4090a35bd51ad90c59ad" } modify_external_catalogs: true
I20260502 20:00:50.305064 11715 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34860:
table { table_name: "default.Table_ac5362bfe46a4090a35bd51ad90c59ad" } modify_external_catalogs: true
@ 0x7f4212d317cc google::LogMessage::Flush() at ??:0
@ 0x7f4212d31a11 google::LogMessage::~LogMessage() at ??:0
I20260502 20:00:50.311477 10975 tablet_service.cc:1558] Processing DeleteTablet for tablet c65cb9d41234432c99c4dfb7240ba0ad with delete_type TABLET_DATA_DELETED (replaced by tablet 3cdb6695c99e4da682e33b146b0e51ab) from {username='slave'} at 127.0.0.1:36978
I20260502 20:00:50.311756 10976 tablet_service.cc:1558] Processing DeleteTablet for tablet c671b41464b74cd1bfcec7eb52043bd3 with delete_type TABLET_DATA_DELETED (replaced by tablet 3ab25bb12883434cace35c4170dbc2e5) from {username='slave'} at 127.0.0.1:36978
I20260502 20:00:50.311864 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet eb15659f8f6549d49f44639345471f6e with delete_type TABLET_DATA_DELETED (replaced by tablet f6de313115d04ebebe7c481d640c260e) from {username='slave'} at 127.0.0.1:36978
I20260502 20:00:50.312347 10974 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bf50334eb414d38ac3c09bcacb6d9bb with delete_type TABLET_DATA_DELETED (replaced by tablet a18f3a9b1f514513a807d0a919db1f20) from {username='slave'} at 127.0.0.1:36978
I20260502 20:00:50.312570 10973 tablet_service.cc:1511] Processing CreateTablet for tablet 3cdb6695c99e4da682e33b146b0e51ab (DEFAULT_TABLE table=default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:50.312860 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cdb6695c99e4da682e33b146b0e51ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:50.313805 11252 tablet_service.cc:1558] Processing DeleteTablet for tablet c65cb9d41234432c99c4dfb7240ba0ad with delete_type TABLET_DATA_DELETED (replaced by tablet 3cdb6695c99e4da682e33b146b0e51ab) from {username='slave'} at 127.0.0.1:46948
I20260502 20:00:50.314082 11251 tablet_service.cc:1558] Processing DeleteTablet for tablet c671b41464b74cd1bfcec7eb52043bd3 with delete_type TABLET_DATA_DELETED (replaced by tablet 3ab25bb12883434cace35c4170dbc2e5) from {username='slave'} at 127.0.0.1:46948
I20260502 20:00:50.314203 11253 tablet_service.cc:1558] Processing DeleteTablet for tablet eb15659f8f6549d49f44639345471f6e with delete_type TABLET_DATA_DELETED (replaced by tablet f6de313115d04ebebe7c481d640c260e) from {username='slave'} at 127.0.0.1:46948
I20260502 20:00:50.314345 11250 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bf50334eb414d38ac3c09bcacb6d9bb with delete_type TABLET_DATA_DELETED (replaced by tablet a18f3a9b1f514513a807d0a919db1f20) from {username='slave'} at 127.0.0.1:46948
I20260502 20:00:50.314615 11249 tablet_service.cc:1511] Processing CreateTablet for tablet 3cdb6695c99e4da682e33b146b0e51ab (DEFAULT_TABLE table=default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:50.314877 11249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cdb6695c99e4da682e33b146b0e51ab. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f42182a5433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 20:00:50.318871 11111 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bf50334eb414d38ac3c09bcacb6d9bb with delete_type TABLET_DATA_DELETED (replaced by tablet a18f3a9b1f514513a807d0a919db1f20) from {username='slave'} at 127.0.0.1:34156
I20260502 20:00:50.318984 11108 tablet_service.cc:1558] Processing DeleteTablet for tablet c65cb9d41234432c99c4dfb7240ba0ad with delete_type TABLET_DATA_DELETED (replaced by tablet 3cdb6695c99e4da682e33b146b0e51ab) from {username='slave'} at 127.0.0.1:34156
I20260502 20:00:50.319176 11109 tablet_service.cc:1558] Processing DeleteTablet for tablet c671b41464b74cd1bfcec7eb52043bd3 with delete_type TABLET_DATA_DELETED (replaced by tablet 3ab25bb12883434cace35c4170dbc2e5) from {username='slave'} at 127.0.0.1:34156
I20260502 20:00:50.319319 11110 tablet_service.cc:1558] Processing DeleteTablet for tablet eb15659f8f6549d49f44639345471f6e with delete_type TABLET_DATA_DELETED (replaced by tablet f6de313115d04ebebe7c481d640c260e) from {username='slave'} at 127.0.0.1:34156
I20260502 20:00:50.319620 11112 tablet_service.cc:1511] Processing CreateTablet for tablet 3cdb6695c99e4da682e33b146b0e51ab (DEFAULT_TABLE table=default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:50.319891 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cdb6695c99e4da682e33b146b0e51ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:50.319989 11926 tablet_replica.cc:333] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:50.320133 11926 raft_consensus.cc:2243] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:50.320353 11926 raft_consensus.cc:2272] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:50.320847 11930 tablet_bootstrap.cc:492] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:50.320941 10973 tablet_service.cc:1511] Processing CreateTablet for tablet f6de313115d04ebebe7c481d640c260e (DEFAULT_TABLE table=default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:50.321167 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6de313115d04ebebe7c481d640c260e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:50.321265 11926 ts_tablet_manager.cc:1916] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:50.321583 11249 tablet_service.cc:1511] Processing CreateTablet for tablet f6de313115d04ebebe7c481d640c260e (DEFAULT_TABLE table=default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:50.321810 11249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6de313115d04ebebe7c481d640c260e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:50.321873 11930 tablet_bootstrap.cc:654] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:50.322516 11928 tablet_replica.cc:333] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:50.322641 11928 raft_consensus.cc:2243] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:50.322746 11928 raft_consensus.cc:2272] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:50.323302 11928 ts_tablet_manager.cc:1916] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:50.323446 11926 ts_tablet_manager.cc:1929] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:50.323513 11926 log.cc:1199] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/c65cb9d41234432c99c4dfb7240ba0ad
I20260502 20:00:50.323742 11929 tablet_bootstrap.cc:492] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:50.323773 11926 ts_tablet_manager.cc:1950] T c65cb9d41234432c99c4dfb7240ba0ad P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:50.324292 11112 tablet_service.cc:1511] Processing CreateTablet for tablet f6de313115d04ebebe7c481d640c260e (DEFAULT_TABLE table=default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:50.324474 11699 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet c65cb9d41234432c99c4dfb7240ba0ad (table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]) successfully deleted
I20260502 20:00:50.324535 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6de313115d04ebebe7c481d640c260e. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f42182a434a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 20:00:50.324733 11929 tablet_bootstrap.cc:654] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:50.327798 10973 tablet_service.cc:1511] Processing CreateTablet for tablet 3ab25bb12883434cace35c4170dbc2e5 (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:50.328049 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab25bb12883434cace35c4170dbc2e5. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f42182a3aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 20:00:50.328421 11110 tablet_service.cc:1511] Processing CreateTablet for tablet 3ab25bb12883434cace35c4170dbc2e5 (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:50.328639 11110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab25bb12883434cace35c4170dbc2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:50.329196 11928 ts_tablet_manager.cc:1929] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:50.329289 11928 log.cc:1199] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/c65cb9d41234432c99c4dfb7240ba0ad
I20260502 20:00:50.329592 11928 ts_tablet_manager.cc:1950] T c65cb9d41234432c99c4dfb7240ba0ad P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:50.330313 11928 tablet_replica.cc:333] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:50.330343 11250 tablet_service.cc:1511] Processing CreateTablet for tablet a18f3a9b1f514513a807d0a919db1f20 (DEFAULT_TABLE table=default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:50.330474 11928 raft_consensus.cc:2243] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:50.330586 11250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18f3a9b1f514513a807d0a919db1f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:50.330691 11926 tablet_replica.cc:333] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:50.330911 11926 raft_consensus.cc:2243] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:50.331058 11926 raft_consensus.cc:2272] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:50.331518 11926 ts_tablet_manager.cc:1916] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:50.331521 11110 tablet_service.cc:1511] Processing CreateTablet for tablet a18f3a9b1f514513a807d0a919db1f20 (DEFAULT_TABLE table=default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:50.331753 11110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18f3a9b1f514513a807d0a919db1f20. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f42182a91b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x55ffb248d244 std::function<>::operator()() at ??:0
I20260502 20:00:50.332793 11699 catalog_manager.cc:5002] TS ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): tablet c65cb9d41234432c99c4dfb7240ba0ad (table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]) successfully deleted
I20260502 20:00:50.333197 11249 tablet_service.cc:1511] Processing CreateTablet for tablet 3ab25bb12883434cace35c4170dbc2e5 (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:50.333420 11249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab25bb12883434cace35c4170dbc2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:50.333936 11926 ts_tablet_manager.cc:1929] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:50.334008 11926 log.cc:1199] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/c671b41464b74cd1bfcec7eb52043bd3
I20260502 20:00:50.334295 11926 ts_tablet_manager.cc:1950] T c671b41464b74cd1bfcec7eb52043bd3 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:50.334620 11932 tablet_bootstrap.cc:492] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:50.335357 11699 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet c671b41464b74cd1bfcec7eb52043bd3 (table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]) successfully deleted
I20260502 20:00:50.335422 11926 tablet_replica.cc:333] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:50.335523 11926 raft_consensus.cc:2243] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:50.335562 10973 tablet_service.cc:1511] Processing CreateTablet for tablet a18f3a9b1f514513a807d0a919db1f20 (DEFAULT_TABLE table=default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:50.335696 11926 raft_consensus.cc:2272] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:50.335760 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18f3a9b1f514513a807d0a919db1f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:50.336043 11926 ts_tablet_manager.cc:1916] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:50.336273 11932 tablet_bootstrap.cc:654] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
@ 0x7f42142367ea kudu::Thread::SuperviseThread() at ??:0
I20260502 20:00:50.337531 11932 tablet_bootstrap.cc:492] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:50.337622 11932 ts_tablet_manager.cc:1403] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:50.337816 11926 ts_tablet_manager.cc:1929] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:50.337880 11926 log.cc:1199] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/eb15659f8f6549d49f44639345471f6e
I20260502 20:00:50.338039 11930 tablet_bootstrap.cc:492] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:50.338124 11926 ts_tablet_manager.cc:1950] T eb15659f8f6549d49f44639345471f6e P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:50.338124 11930 ts_tablet_manager.cc:1403] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20260502 20:00:50.338245 11932 raft_consensus.cc:359] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.338366 11932 raft_consensus.cc:385] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:50.338405 11932 raft_consensus.cc:740] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:50.338553 11932 consensus_queue.cc:260] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.338722 11926 tablet_replica.cc:333] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:50.338829 11926 raft_consensus.cc:2243] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:50.338812 11699 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet eb15659f8f6549d49f44639345471f6e (table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc]) successfully deleted
I20260502 20:00:50.338920 11932 ts_tablet_manager.cc:1434] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260502 20:00:50.338963 11926 raft_consensus.cc:2272] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:50.339154 11932 tablet_bootstrap.cc:492] T f6de313115d04ebebe7c481d640c260e P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:50.339321 11930 raft_consensus.cc:359] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.339422 11930 raft_consensus.cc:385] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:50.339454 11930 raft_consensus.cc:740] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
@ 0x7f4214b7a6db start_thread at ??:0
I20260502 20:00:50.339982 11930 consensus_queue.cc:260] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.340080 11926 ts_tablet_manager.cc:1916] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:50.340284 11930 ts_tablet_manager.cc:1434] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 20:00:50.340415 11932 tablet_bootstrap.cc:654] T f6de313115d04ebebe7c481d640c260e P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:50.340466 11930 tablet_bootstrap.cc:492] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:50.342308 11932 tablet_bootstrap.cc:492] T f6de313115d04ebebe7c481d640c260e P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:50.342392 11932 ts_tablet_manager.cc:1403] T f6de313115d04ebebe7c481d640c260e P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260502 20:00:50.342906 11932 raft_consensus.cc:359] T f6de313115d04ebebe7c481d640c260e P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.343067 11932 raft_consensus.cc:385] T f6de313115d04ebebe7c481d640c260e P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:50.343111 11932 raft_consensus.cc:740] T f6de313115d04ebebe7c481d640c260e P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:50.343247 11932 consensus_queue.cc:260] T f6de313115d04ebebe7c481d640c260e P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
@ 0x7f4211ee861f clone at ??:0
I20260502 20:00:50.344002 11926 ts_tablet_manager.cc:1929] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:50.344074 11926 log.cc:1199] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/2bf50334eb414d38ac3c09bcacb6d9bb
I20260502 20:00:50.344486 11932 ts_tablet_manager.cc:1434] T f6de313115d04ebebe7c481d640c260e P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260502 20:00:50.344833 11932 tablet_bootstrap.cc:492] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:50.345309 11926 ts_tablet_manager.cc:1950] T 2bf50334eb414d38ac3c09bcacb6d9bb P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:50.330587 11928 raft_consensus.cc:2272] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:50.346215 11931 tablet_replica.cc:333] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:50.346331 11931 raft_consensus.cc:2243] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:50.346441 11931 raft_consensus.cc:2272] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:50.346431 11928 ts_tablet_manager.cc:1916] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:50.346527 11932 tablet_bootstrap.cc:654] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:50.347177 11929 tablet_bootstrap.cc:492] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:50.347221 11931 ts_tablet_manager.cc:1916] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:50.347267 11929 ts_tablet_manager.cc:1403] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20260502 20:00:50.347788 11929 raft_consensus.cc:359] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.347883 11929 raft_consensus.cc:385] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:50.347915 11929 raft_consensus.cc:740] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:50.348045 11929 consensus_queue.cc:260] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.348328 11929 ts_tablet_manager.cc:1434] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:00:50.348485 11929 tablet_bootstrap.cc:492] T f6de313115d04ebebe7c481d640c260e P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:50.349539 11929 tablet_bootstrap.cc:654] T f6de313115d04ebebe7c481d640c260e P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:50.349828 11932 tablet_bootstrap.cc:492] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:50.349915 11932 ts_tablet_manager.cc:1403] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260502 20:00:50.350426 11932 raft_consensus.cc:359] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.350492 11928 ts_tablet_manager.cc:1929] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:50.350533 11932 raft_consensus.cc:385] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:50.350555 11928 log.cc:1199] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/c671b41464b74cd1bfcec7eb52043bd3
I20260502 20:00:50.350572 11932 raft_consensus.cc:740] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:50.350740 11931 ts_tablet_manager.cc:1929] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:50.350703 11932 consensus_queue.cc:260] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.350804 11931 log.cc:1199] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/2bf50334eb414d38ac3c09bcacb6d9bb
I20260502 20:00:50.350826 11928 ts_tablet_manager.cc:1950] T c671b41464b74cd1bfcec7eb52043bd3 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:50.341437 11930 tablet_bootstrap.cc:654] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:50.351061 11932 ts_tablet_manager.cc:1434] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260502 20:00:50.351246 11932 tablet_bootstrap.cc:492] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:50.351331 11931 ts_tablet_manager.cc:1950] T 2bf50334eb414d38ac3c09bcacb6d9bb P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:50.352164 11932 tablet_bootstrap.cc:654] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:50.352181 11931 tablet_replica.cc:333] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:50.352847 11929 tablet_bootstrap.cc:492] T f6de313115d04ebebe7c481d640c260e P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:50.352928 11929 ts_tablet_manager.cc:1403] T f6de313115d04ebebe7c481d640c260e P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 20:00:50.353684 11929 raft_consensus.cc:359] T f6de313115d04ebebe7c481d640c260e P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.353780 11929 raft_consensus.cc:385] T f6de313115d04ebebe7c481d640c260e P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:50.353801 11929 raft_consensus.cc:740] T f6de313115d04ebebe7c481d640c260e P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:50.353938 11929 consensus_queue.cc:260] T f6de313115d04ebebe7c481d640c260e P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.354545 11929 ts_tablet_manager.cc:1434] T f6de313115d04ebebe7c481d640c260e P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 20:00:50.354876 11929 tablet_bootstrap.cc:492] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:50.355803 11929 tablet_bootstrap.cc:654] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:50.356491 11928 tablet_replica.cc:333] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:50.356626 11928 raft_consensus.cc:2243] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:50.356758 11928 raft_consensus.cc:2272] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:50.356881 11929 tablet_bootstrap.cc:492] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:50.356953 11929 ts_tablet_manager.cc:1403] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260502 20:00:50.357141 11928 ts_tablet_manager.cc:1916] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:50.357389 11929 raft_consensus.cc:359] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.357508 11929 raft_consensus.cc:385] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:50.357547 11929 raft_consensus.cc:740] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:50.357669 11929 consensus_queue.cc:260] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.358106 11929 ts_tablet_manager.cc:1434] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:50.358276 11929 tablet_bootstrap.cc:492] T a18f3a9b1f514513a807d0a919db1f20 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:50.356353 11931 raft_consensus.cc:2243] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:50.359092 11931 raft_consensus.cc:2272] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:50.359395 11928 ts_tablet_manager.cc:1929] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:50.359462 11928 log.cc:1199] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/eb15659f8f6549d49f44639345471f6e
I20260502 20:00:50.359519 11929 tablet_bootstrap.cc:654] T a18f3a9b1f514513a807d0a919db1f20 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:50.359704 11928 ts_tablet_manager.cc:1950] T eb15659f8f6549d49f44639345471f6e P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:50.360241 11931 ts_tablet_manager.cc:1916] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:50.361021 11928 tablet_replica.cc:333] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:50.361141 11928 raft_consensus.cc:2243] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:50.361318 11928 raft_consensus.cc:2272] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:50.361800 11928 ts_tablet_manager.cc:1916] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:50.362159 11931 ts_tablet_manager.cc:1929] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:50.362207 11931 log.cc:1199] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/c65cb9d41234432c99c4dfb7240ba0ad
I20260502 20:00:50.362388 11931 ts_tablet_manager.cc:1950] T c65cb9d41234432c99c4dfb7240ba0ad P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:50.363207 11932 tablet_bootstrap.cc:492] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:50.363252 11930 tablet_bootstrap.cc:492] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:50.363298 11932 ts_tablet_manager.cc:1403] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20260502 20:00:50.363323 11930 ts_tablet_manager.cc:1403] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20260502 20:00:50.363791 11930 raft_consensus.cc:359] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.363787 11932 raft_consensus.cc:359] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.363862 11928 ts_tablet_manager.cc:1929] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:50.363883 11930 raft_consensus.cc:385] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:50.363883 11932 raft_consensus.cc:385] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:50.363919 11930 raft_consensus.cc:740] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:50.363937 11932 raft_consensus.cc:740] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:50.364063 11932 consensus_queue.cc:260] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.364101 11930 consensus_queue.cc:260] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.363929 11928 log.cc:1199] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/2bf50334eb414d38ac3c09bcacb6d9bb
I20260502 20:00:50.364380 11932 ts_tablet_manager.cc:1434] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:00:50.364449 11930 ts_tablet_manager.cc:1434] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:50.364573 11928 ts_tablet_manager.cc:1950] T 2bf50334eb414d38ac3c09bcacb6d9bb P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:50.364974 11930 tablet_bootstrap.cc:492] T a18f3a9b1f514513a807d0a919db1f20 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:50.365466 11931 tablet_replica.cc:333] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:50.365579 11931 raft_consensus.cc:2243] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:50.365749 11931 raft_consensus.cc:2272] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:50.366102 11931 ts_tablet_manager.cc:1916] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:50.366288 11930 tablet_bootstrap.cc:654] T a18f3a9b1f514513a807d0a919db1f20 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:50.369753 11931 ts_tablet_manager.cc:1929] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:50.369822 11931 log.cc:1199] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/c671b41464b74cd1bfcec7eb52043bd3
I20260502 20:00:50.370069 11931 ts_tablet_manager.cc:1950] T c671b41464b74cd1bfcec7eb52043bd3 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:50.370105 11929 tablet_bootstrap.cc:492] T a18f3a9b1f514513a807d0a919db1f20 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:50.370199 11929 ts_tablet_manager.cc:1403] T a18f3a9b1f514513a807d0a919db1f20 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260502 20:00:50.370738 11931 tablet_replica.cc:333] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:50.370857 11931 raft_consensus.cc:2243] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:50.370878 11929 raft_consensus.cc:359] T a18f3a9b1f514513a807d0a919db1f20 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.371007 11929 raft_consensus.cc:385] T a18f3a9b1f514513a807d0a919db1f20 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:50.371033 11931 raft_consensus.cc:2272] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:50.371057 11929 raft_consensus.cc:740] T a18f3a9b1f514513a807d0a919db1f20 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:50.371186 11929 consensus_queue.cc:260] T a18f3a9b1f514513a807d0a919db1f20 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.371402 11931 ts_tablet_manager.cc:1916] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:50.371464 11929 ts_tablet_manager.cc:1434] T a18f3a9b1f514513a807d0a919db1f20 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:50.373631 11930 tablet_bootstrap.cc:492] T a18f3a9b1f514513a807d0a919db1f20 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:50.373719 11930 ts_tablet_manager.cc:1403] T a18f3a9b1f514513a807d0a919db1f20 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260502 20:00:50.374377 11931 ts_tablet_manager.cc:1929] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:50.374337 11930 raft_consensus.cc:359] T a18f3a9b1f514513a807d0a919db1f20 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.374434 11931 log.cc:1199] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/eb15659f8f6549d49f44639345471f6e
I20260502 20:00:50.374447 11930 raft_consensus.cc:385] T a18f3a9b1f514513a807d0a919db1f20 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:50.374485 11930 raft_consensus.cc:740] T a18f3a9b1f514513a807d0a919db1f20 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:50.374627 11930 consensus_queue.cc:260] T a18f3a9b1f514513a807d0a919db1f20 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.374686 11931 ts_tablet_manager.cc:1950] T eb15659f8f6549d49f44639345471f6e P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:50.375061 11930 ts_tablet_manager.cc:1434] T a18f3a9b1f514513a807d0a919db1f20 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260502 20:00:50.375257 11930 tablet_bootstrap.cc:492] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:50.376199 11930 tablet_bootstrap.cc:654] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:50.378484 11562 raft_consensus.cc:493] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:50.378573 11562 raft_consensus.cc:515] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.378911 11930 tablet_bootstrap.cc:492] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:50.379025 11562 leader_election.cc:290] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:50.379055 11930 ts_tablet_manager.cc:1403] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260502 20:00:50.379349 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18f3a9b1f514513a807d0a919db1f20" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:50.379379 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18f3a9b1f514513a807d0a919db1f20" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:50.379462 11273 raft_consensus.cc:2468] T a18f3a9b1f514513a807d0a919db1f20 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:50.379492 10995 raft_consensus.cc:2468] T a18f3a9b1f514513a807d0a919db1f20 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:50.379760 11065 leader_election.cc:304] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:50.379941 11562 raft_consensus.cc:2804] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:50.379989 11562 raft_consensus.cc:493] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:50.380028 11562 raft_consensus.cc:3060] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:50.380283 11930 raft_consensus.cc:359] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.380398 11930 raft_consensus.cc:385] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:50.380429 11930 raft_consensus.cc:740] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:50.380591 11930 consensus_queue.cc:260] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.380895 11930 ts_tablet_manager.cc:1434] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260502 20:00:50.380937 11562 raft_consensus.cc:515] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.381362 11562 leader_election.cc:290] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:50.382017 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18f3a9b1f514513a807d0a919db1f20" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:50.382117 11273 raft_consensus.cc:3060] T a18f3a9b1f514513a807d0a919db1f20 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:50.382166 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18f3a9b1f514513a807d0a919db1f20" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:50.382280 10995 raft_consensus.cc:3060] T a18f3a9b1f514513a807d0a919db1f20 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:50.383086 11273 raft_consensus.cc:2468] T a18f3a9b1f514513a807d0a919db1f20 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:50.383257 10995 raft_consensus.cc:2468] T a18f3a9b1f514513a807d0a919db1f20 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:50.383571 11065 leader_election.cc:304] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:50.383837 11562 raft_consensus.cc:2804] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:50.383917 11562 raft_consensus.cc:697] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:50.384048 11562 consensus_queue.cc:237] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.448282 11612 consensus_queue.cc:1048] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:50.452195 11612 consensus_queue.cc:1048] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:50.460671 11612 raft_consensus.cc:493] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:50.460842 11612 raft_consensus.cc:515] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.461282 11612 leader_election.cc:290] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:50.461737 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab25bb12883434cace35c4170dbc2e5" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:50.461757 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab25bb12883434cace35c4170dbc2e5" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:50.461911 11273 raft_consensus.cc:2468] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:50.461908 10995 raft_consensus.cc:2468] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:50.462263 11065 leader_election.cc:304] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:50.462481 11612 raft_consensus.cc:2804] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:50.462553 11612 raft_consensus.cc:493] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:50.462637 11612 raft_consensus.cc:3060] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:50.463619 11612 raft_consensus.cc:515] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.463969 11612 leader_election.cc:290] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:50.464406 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab25bb12883434cace35c4170dbc2e5" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:50.464447 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab25bb12883434cace35c4170dbc2e5" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:50.464546 10995 raft_consensus.cc:3060] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:50.464560 11273 raft_consensus.cc:3060] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:50.465504 11273 raft_consensus.cc:2468] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:50.465504 10995 raft_consensus.cc:2468] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:50.465848 11065 leader_election.cc:304] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:50.466051 11612 raft_consensus.cc:2804] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:50.466180 11612 raft_consensus.cc:697] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:50.466552 11612 consensus_queue.cc:237] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.535152 11643 raft_consensus.cc:493] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:50.535287 11643 raft_consensus.cc:515] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.535773 11643 leader_election.cc:290] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:50.536206 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6de313115d04ebebe7c481d640c260e" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:50.536211 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6de313115d04ebebe7c481d640c260e" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:50.536363 10995 raft_consensus.cc:2468] T f6de313115d04ebebe7c481d640c260e P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:50.536368 11131 raft_consensus.cc:2468] T f6de313115d04ebebe7c481d640c260e P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:50.536720 11209 leader_election.cc:304] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:50.537123 11643 raft_consensus.cc:2804] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:50.537196 11643 raft_consensus.cc:493] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:50.537247 11643 raft_consensus.cc:3060] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:50.538278 11643 raft_consensus.cc:515] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.538621 11643 leader_election.cc:290] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:50.538980 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6de313115d04ebebe7c481d640c260e" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:50.539067 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6de313115d04ebebe7c481d640c260e" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:50.539134 10995 raft_consensus.cc:3060] T f6de313115d04ebebe7c481d640c260e P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:50.539167 11131 raft_consensus.cc:3060] T f6de313115d04ebebe7c481d640c260e P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:50.540045 11131 raft_consensus.cc:2468] T f6de313115d04ebebe7c481d640c260e P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:50.540321 11209 leader_election.cc:304] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:50.540335 10995 raft_consensus.cc:2468] T f6de313115d04ebebe7c481d640c260e P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:50.540475 11643 raft_consensus.cc:2804] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:50.540627 11643 raft_consensus.cc:697] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Becoming Leader. State: Replica: ade741c4062940adb2223b55187ffe72, State: Running, Role: LEADER
I20260502 20:00:50.540751 11643 consensus_queue.cc:237] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
W20260502 20:00:50.543582 11068 connection.cc:570] server connection from 127.0.0.1:34156 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:50.543601 10932 connection.cc:570] server connection from 127.0.0.1:36978 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:50.543606 11208 connection.cc:570] server connection from 127.0.0.1:46948 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:50.543967 11326 connection.cc:570] client connection to 127.10.27.189:46281 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:50.548108 11897 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 20:00:50.545470 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.10.27.189:46281 (local address 127.0.0.1:34876)
0502 20:00:50.545690 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0502 20:00:50.545703 (+ 13us) client_negotiation.cc:175] Beginning negotiation
0502 20:00:50.545781 (+ 78us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 20:00:50.547347 (+ 1566us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":143}
I20260502 20:00:50.601562 11612 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:50.601696 11612 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.602353 11612 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:50.602718 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdb6695c99e4da682e33b146b0e51ab" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:50.602751 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdb6695c99e4da682e33b146b0e51ab" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:50.602880 10995 raft_consensus.cc:2468] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:50.602913 11273 raft_consensus.cc:2468] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:50.603259 11065 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:50.603526 11612 raft_consensus.cc:2804] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:50.603598 11612 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:50.603667 11612 raft_consensus.cc:3060] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:50.604524 11612 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.604903 11612 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:50.605248 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdb6695c99e4da682e33b146b0e51ab" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:50.605352 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdb6695c99e4da682e33b146b0e51ab" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:50.605386 10995 raft_consensus.cc:3060] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:50.605485 11273 raft_consensus.cc:3060] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:50.606220 10995 raft_consensus.cc:2468] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:50.606246 11273 raft_consensus.cc:2468] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:50.606537 11065 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:50.606729 11612 raft_consensus.cc:2804] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:50.606845 11612 raft_consensus.cc:697] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:50.607028 11612 consensus_queue.cc:237] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:50.814010 11964 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:00:50.814153 11964 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:50.814699 11964 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:00:50.815945 10791 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:00:50.816045 10790 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:00:50.816136 10790 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:00:50.816323 11964 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260502 20:00:50.822086 11612 consensus_queue.cc:1048] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:50.825700 11612 consensus_queue.cc:1048] T a18f3a9b1f514513a807d0a919db1f20 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:50.927227 11562 consensus_queue.cc:1048] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:50.932683 11612 consensus_queue.cc:1048] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:50.988850 11562 consensus_queue.cc:1048] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:50.993352 11562 consensus_queue.cc:1048] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:51.003201 11643 consensus_queue.cc:1048] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:51.007494 11978 consensus_queue.cc:1048] T f6de313115d04ebebe7c481d640c260e P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:51.102737 10350 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu with pid 10773
I20260502 20:00:51.944875 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.188:33369
--webserver_interface=127.10.27.188
--webserver_port=35669
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 20:00:52.071451 11989 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:00:52.071792 11989 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:00:52.071856 11989 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:00:52.076120 11989 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 20:00:52.076313 11989 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:00:52.076435 11989 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 20:00:52.076474 11989 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 20:00:52.082423 11989 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.188:33369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.27.188
--webserver_port=35669
--never_fsync=true
--heap_profile_path=/tmp/kudu.11989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:00:52.083981 11989 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:00:52.085340 11989 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:00:52.092299 12001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:52.092351 12004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:52.092324 12002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:00:52.092717 11989 server_base.cc:1061] running on GCE node
I20260502 20:00:52.093331 11989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:00:52.094297 11989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:00:52.095490 11989 hybrid_clock.cc:648] HybridClock initialized: now 1777752052095464 us; error 45 us; skew 500 ppm
I20260502 20:00:52.097922 11989 webserver.cc:492] Webserver started at http://127.10.27.188:35669/ using document root <none> and password file <none>
I20260502 20:00:52.098589 11989 fs_manager.cc:362] Metadata directory not provided
I20260502 20:00:52.098664 11989 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:00:52.103412 11989 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260502 20:00:52.105842 12010 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:52.107605 11989 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260502 20:00:52.107770 11989 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
uuid: "b470a66ad54f46b1b44a80dd1edf214e"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:00:52.108253 11989 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:00:52.123884 11989 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:00:52.124699 11989 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:00:52.124940 11989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:00:52.133912 11989 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.188:33369
I20260502 20:00:52.133957 12062 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.188:33369 every 8 connection(s)
I20260502 20:00:52.135403 11989 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
I20260502 20:00:52.140106 12063 sys_catalog.cc:263] Verifying existing consensus state
I20260502 20:00:52.141848 12063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Bootstrap starting.
I20260502 20:00:52.142733 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 11989
I20260502 20:00:52.157512 12063 log.cc:826] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Log is configured to *not* fsync() on all Append() calls
I20260502 20:00:52.218154 12063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Bootstrap replayed 1/1 log segments. Stats: ops{read=113 overwritten=0 applied=113 ignored=0} inserts{seen=67 ignored=0} mutations{seen=97 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:00:52.218848 12063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Bootstrap complete.
I20260502 20:00:52.221858 12063 raft_consensus.cc:359] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:52.222222 12063 raft_consensus.cc:740] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: b470a66ad54f46b1b44a80dd1edf214e, State: Initialized, Role: FOLLOWER
I20260502 20:00:52.222687 12063 consensus_queue.cc:260] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 113, Last appended: 5.113, Last appended by leader: 113, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:52.223214 12068 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:52.223387 12068 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:52.223875 12063 sys_catalog.cc:565] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: configured and running, proceeding with master startup.
I20260502 20:00:52.230799 12082 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:00:52.231637 12082 catalog_manager.cc:1562] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: loading cluster ID for follower catalog manager: success
I20260502 20:00:52.230792 11989 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:00:52.233296 11989 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:00:52.234534 12082 catalog_manager.cc:1584] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: acquiring CA information for follower catalog manager: success
I20260502 20:00:52.236529 12082 catalog_manager.cc:1612] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 20:00:52.518838 11043 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:00:52.520764 12027 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" instance_seqno: 1777752043533877) as {username='slave'} at 127.10.27.129:42005; Asking this server to re-register.
I20260502 20:00:52.521817 11043 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:52.523685 12027 ts_manager.cc:194] Registered new tserver with Master: 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:52.535094 11178 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:00:52.536418 12027 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" instance_seqno: 1777752043728997) as {username='slave'} at 127.10.27.130:58491; Asking this server to re-register.
I20260502 20:00:52.536880 11178 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:52.538035 12027 ts_manager.cc:194] Registered new tserver with Master: b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:52.583122 11319 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:00:52.584599 12027 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ade741c4062940adb2223b55187ffe72" instance_seqno: 1777752043938024) as {username='slave'} at 127.10.27.131:45019; Asking this server to re-register.
I20260502 20:00:52.585284 11319 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:52.586555 12023 ts_manager.cc:194] Registered new tserver with Master: ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:52.648051 12068 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:52.648257 12068 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:52.649749 12068 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:00:52.650092 12012 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:00:52.650898 12012 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:00:52.651038 12011 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:00:52.651155 12011 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:00:52.651428 12068 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260502 20:00:53.374701 12099 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:53.374830 12099 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:53.375442 12099 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:00:53.376788 12011 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:00:53.376871 12012 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:00:53.376933 12012 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:00:53.377089 12099 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260502 20:00:54.252223 12117 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:54.252343 12117 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:54.252781 12117 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:00:54.254134 12011 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:00:54.254400 12012 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:00:54.254460 12012 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:00:54.254586 12117 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260502 20:00:55.010388 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.190:46101
--webserver_interface=127.10.27.190
--webserver_port=38717
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 20:00:55.142863 12127 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:00:55.143180 12127 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:00:55.143270 12127 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:00:55.147301 12127 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 20:00:55.147397 12127 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:00:55.147435 12127 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 20:00:55.147496 12127 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 20:00:55.151764 12127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.190:46101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.27.190
--webserver_port=38717
--never_fsync=true
--heap_profile_path=/tmp/kudu.12127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:00:55.152961 12127 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:00:55.154240 12127 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:00:55.161482 12138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:55.161566 12137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:55.161499 12140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:00:55.161785 12127 server_base.cc:1061] running on GCE node
I20260502 20:00:55.162530 12127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:00:55.163571 12127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:00:55.164753 12127 hybrid_clock.cc:648] HybridClock initialized: now 1777752055164726 us; error 35 us; skew 500 ppm
I20260502 20:00:55.166865 12127 webserver.cc:492] Webserver started at http://127.10.27.190:38717/ using document root <none> and password file <none>
I20260502 20:00:55.167508 12127 fs_manager.cc:362] Metadata directory not provided
I20260502 20:00:55.167565 12127 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:00:55.171422 12127 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260502 20:00:55.173532 12146 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:55.174603 12127 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260502 20:00:55.174706 12127 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
uuid: "38315e4f56484666b5e54afad02498ec"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:00:55.175261 12127 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:00:55.198796 12127 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:00:55.199533 12127 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:00:55.199688 12127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:00:55.207542 12127 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.190:46101
I20260502 20:00:55.207614 12198 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.190:46101 every 8 connection(s)
I20260502 20:00:55.208719 12127 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-0/data/info.pb
I20260502 20:00:55.213115 12199 sys_catalog.cc:263] Verifying existing consensus state
I20260502 20:00:55.214921 12199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Bootstrap starting.
I20260502 20:00:55.217615 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 12127
I20260502 20:00:55.228902 12199 log.cc:826] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Log is configured to *not* fsync() on all Append() calls
I20260502 20:00:55.283886 12199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Bootstrap replayed 1/1 log segments. Stats: ops{read=106 overwritten=0 applied=106 ignored=0} inserts{seen=63 ignored=0} mutations{seen=89 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:00:55.284288 12199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Bootstrap complete.
I20260502 20:00:55.287083 12199 raft_consensus.cc:359] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:55.287469 12199 raft_consensus.cc:740] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38315e4f56484666b5e54afad02498ec, State: Initialized, Role: FOLLOWER
I20260502 20:00:55.287868 12199 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 106, Last appended: 4.106, Last appended by leader: 106, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:55.288352 12203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:55.288522 12203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:55.289000 12199 sys_catalog.cc:565] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: configured and running, proceeding with master startup.
I20260502 20:00:55.295774 12217 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:00:55.296211 12217 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: loading cluster ID for follower catalog manager: success
I20260502 20:00:55.300071 12217 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: acquiring CA information for follower catalog manager: success
I20260502 20:00:55.301896 12217 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 20:00:55.300594 12127 master_runner.cc:186] Error getting master registration for 127.10.27.189:46281: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111),
I20260502 20:00:55.302641 12127 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:00:55.524178 11044 heartbeater.cc:344] Connected to a master server at 127.10.27.190:46101
I20260502 20:00:55.526317 12163 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" instance_seqno: 1777752043533877) as {username='slave'} at 127.10.27.129:39663; Asking this server to re-register.
I20260502 20:00:55.526893 11044 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:55.528368 12163 ts_manager.cc:194] Registered new tserver with Master: 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:55.542275 11179 heartbeater.cc:344] Connected to a master server at 127.10.27.190:46101
I20260502 20:00:55.543897 12163 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" instance_seqno: 1777752043728997) as {username='slave'} at 127.10.27.130:57657; Asking this server to re-register.
I20260502 20:00:55.544409 11179 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:55.545498 12163 ts_manager.cc:194] Registered new tserver with Master: b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:55.587318 12227 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:55.587461 12227 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:55.587941 12227 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:00:55.589401 12011 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:00:55.591281 11320 heartbeater.cc:344] Connected to a master server at 127.10.27.190:46101
I20260502 20:00:55.592229 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b470a66ad54f46b1b44a80dd1edf214e" candidate_term: 6 candidate_status { last_received { term: 5 index: 113 } } ignore_live_leader: false dest_uuid: "38315e4f56484666b5e54afad02498ec" is_pre_election: true
I20260502 20:00:55.592564 12173 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b470a66ad54f46b1b44a80dd1edf214e in term 4.
I20260502 20:00:55.592864 12163 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ade741c4062940adb2223b55187ffe72" instance_seqno: 1777752043938024) as {username='slave'} at 127.10.27.131:47435; Asking this server to re-register.
I20260502 20:00:55.593142 12012 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e; no voters: ef9294b460014382a2a594c77f8900d4
I20260502 20:00:55.593369 12227 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260502 20:00:55.593453 11320 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:55.593449 12227 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:55.593503 12227 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 5 FOLLOWER]: Advancing to term 6
I20260502 20:00:55.594643 12163 ts_manager.cc:194] Registered new tserver with Master: ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:55.595747 12227 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:55.596117 12227 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 election: Requested vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
I20260502 20:00:55.596400 12173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b470a66ad54f46b1b44a80dd1edf214e" candidate_term: 6 candidate_status { last_received { term: 5 index: 113 } } ignore_live_leader: false dest_uuid: "38315e4f56484666b5e54afad02498ec"
I20260502 20:00:55.596532 12173 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 4 FOLLOWER]: Advancing to term 6
W20260502 20:00:55.597154 12011 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:00:55.598364 12173 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b470a66ad54f46b1b44a80dd1edf214e in term 6.
I20260502 20:00:55.598675 12012 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e; no voters: ef9294b460014382a2a594c77f8900d4
I20260502 20:00:55.598851 12227 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 6 FOLLOWER]: Leader election won for term 6
I20260502 20:00:55.599112 12227 raft_consensus.cc:697] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 6 LEADER]: Becoming Leader. State: Replica: b470a66ad54f46b1b44a80dd1edf214e, State: Running, Role: LEADER
I20260502 20:00:55.599418 12227 consensus_queue.cc:237] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 5.113, Last appended by leader: 113, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:55.601045 12232 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b470a66ad54f46b1b44a80dd1edf214e. Latest consensus state: current_term: 6 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:55.601156 12232 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:55.601475 12234 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 20:00:55.603390 12234 catalog_manager.cc:679] Loaded metadata for table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc]
I20260502 20:00:55.603689 12234 catalog_manager.cc:679] Loaded metadata for table default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]
I20260502 20:00:55.603859 12234 catalog_manager.cc:679] Loaded metadata for table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]
I20260502 20:00:55.604008 12234 catalog_manager.cc:679] Loaded metadata for table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]
I20260502 20:00:55.604171 12234 catalog_manager.cc:679] Loaded metadata for table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]
I20260502 20:00:55.604411 12234 catalog_manager.cc:679] Loaded metadata for table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]
I20260502 20:00:55.604616 12234 catalog_manager.cc:679] Loaded metadata for table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]
I20260502 20:00:55.604803 12234 catalog_manager.cc:679] Loaded metadata for table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]
I20260502 20:00:55.604985 12234 catalog_manager.cc:679] Loaded metadata for table default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150]
I20260502 20:00:55.605397 12234 catalog_manager.cc:679] Loaded metadata for table default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]
I20260502 20:00:55.605623 12234 catalog_manager.cc:679] Loaded metadata for table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f]
I20260502 20:00:55.605839 12234 catalog_manager.cc:679] Loaded metadata for table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2]
I20260502 20:00:55.606062 12234 catalog_manager.cc:679] Loaded metadata for table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63]
I20260502 20:00:55.606289 12234 catalog_manager.cc:679] Loaded metadata for table default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b]
I20260502 20:00:55.606518 12234 catalog_manager.cc:679] Loaded metadata for table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]
I20260502 20:00:55.607841 12234 tablet_loader.cc:96] loaded metadata for tablet 0ea263d32fd2405985d4514c2ff02a39 (table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f])
I20260502 20:00:55.608088 12234 tablet_loader.cc:96] loaded metadata for tablet 11548942c58f4c05bad32038a55b8f66 (table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63])
I20260502 20:00:55.608462 12234 tablet_loader.cc:96] loaded metadata for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b])
I20260502 20:00:55.608662 12234 tablet_loader.cc:96] loaded metadata for tablet 35074187f6b140ea888ef0f2a692bb93 (table default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee])
I20260502 20:00:55.609010 12234 tablet_loader.cc:96] loaded metadata for tablet 3ab25bb12883434cace35c4170dbc2e5 (table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f])
I20260502 20:00:55.609252 12234 tablet_loader.cc:96] loaded metadata for tablet 3cdb6695c99e4da682e33b146b0e51ab (table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86])
I20260502 20:00:55.610118 12234 tablet_loader.cc:96] loaded metadata for tablet 9df3ebd756b248d0b92bad3259e7a122 (table default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150])
I20260502 20:00:55.610396 12234 tablet_loader.cc:96] loaded metadata for tablet a18f3a9b1f514513a807d0a919db1f20 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760])
I20260502 20:00:55.610579 12234 tablet_loader.cc:96] loaded metadata for tablet aa0b66d220bf46fe853b2f03778b2096 (table default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b])
I20260502 20:00:55.610759 12234 tablet_loader.cc:96] loaded metadata for tablet af5837b307bb43258aa75c9a947dd5c6 (table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b])
I20260502 20:00:55.610991 12234 tablet_loader.cc:96] loaded metadata for tablet b3f6a9613e594f12b0e518d0b9d9e7ed (table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064])
I20260502 20:00:55.611611 12234 tablet_loader.cc:96] loaded metadata for tablet c8e6be4db78c4544bca924bcbff3a4b9 (table default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02])
I20260502 20:00:55.611881 12234 tablet_loader.cc:96] loaded metadata for tablet db76c47bb09042b5ac706c4b80fc3bb9 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464])
I20260502 20:00:55.612067 12234 tablet_loader.cc:96] loaded metadata for tablet e43e158d448442d3811dbdfe82db47ca (table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2])
I20260502 20:00:55.612409 12234 tablet_loader.cc:96] loaded metadata for tablet f6de313115d04ebebe7c481d640c260e (table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc])
I20260502 20:00:55.612679 12234 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 20:00:55.613396 12234 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:00:55.613469 12234 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 20:00:55.614187 12234 catalog_manager.cc:1514] Loading token signing keys...
I20260502 20:00:55.614718 12234 catalog_manager.cc:6055] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Loaded TSK: 0
I20260502 20:00:55.615465 12234 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 20:00:55.616055 12234 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 20:00:55.616654 12234 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 24
I20260502 20:00:55.664350 12027 master_service.cc:954] ReplaceTablet: received request to replace tablet db76c47bb09042b5ac706c4b80fc3bb9 from {username='slave'} at 127.0.0.1:42316
I20260502 20:00:55.664755 12024 master_service.cc:954] ReplaceTablet: received request to replace tablet 35074187f6b140ea888ef0f2a692bb93 from {username='slave'} at 127.0.0.1:42316
I20260502 20:00:55.664996 12025 master_service.cc:954] ReplaceTablet: received request to replace tablet aa0b66d220bf46fe853b2f03778b2096 from {username='slave'} at 127.0.0.1:42316
I20260502 20:00:55.665252 12018 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42316:
table { table_name: "default.Table_e3ad181715724e36aa7276f9790d41bf" } new_table_name: "default.Table_9fb8cc097c6f4bd48e5f41dd70218be1" modify_external_catalogs: true
I20260502 20:00:55.665671 12020 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42316:
table { table_name: "default.Table_d4efc4ecb8b04c828595edb245352971" } new_table_name: "default.Table_fd2a46a7a29e42429193d222c7c5037f" modify_external_catalogs: true
I20260502 20:00:55.665939 12019 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42316:
table { table_name: "default.Table_0d8473dff6e244c199473f589d46be1b" } new_table_name: "default.Table_41eddb5da0424c5ea3a77e1f59af0916" modify_external_catalogs: true
I20260502 20:00:55.666034 12022 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42316:
name: "default.Table_6b8d71e2af3a4d8ca933ba45c43b464e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:55.666177 12021 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42316:
name: "default.Table_8fe0445705b144e5adbda1bd0c71ba52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:55.666685 12023 master_service.cc:954] ReplaceTablet: received request to replace tablet 35074187f6b140ea888ef0f2a692bb93 from {username='slave'} at 127.0.0.1:42316
I20260502 20:00:55.666875 12026 master_service.cc:954] ReplaceTablet: received request to replace tablet 3ab25bb12883434cace35c4170dbc2e5 from {username='slave'} at 127.0.0.1:42316
I20260502 20:00:55.669481 12173 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Refusing update from remote peer b470a66ad54f46b1b44a80dd1edf214e: Log matching property violated. Preceding OpId in replica: term: 4 index: 106. Preceding OpId from leader: term: 6 index: 115. (index mismatch)
I20260502 20:00:55.670178 12232 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [LEADER]: Connected to new peer: Peer: permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 114, Last known committed idx: 106, Time since last communication: 0.000s
F20260502 20:00:55.677574 12081 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 26, previous 26; dumping first 3 out of 13 received events: NotificationEvent(eventId=25, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_b19cf190454d42ff99d3fcab96f783b1, message={"server":"","servicePrincipal":"","db":"default","table":"table_b19cf190454d42ff99d3fcab96f783b1","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_b19cf190454d42ff99d3fcab96f783b1\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752048},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b19cf190454d42ff99d3fcab96f783b1\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b19cf190454d42ff99d3fcab96f783b1\",\"kudu.table_id\":\"33b0206efcd84429a0b2bc366a81e1fb\",\"transient_lastDdlTime\":\"1777752048\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=ALTER_TABLE, dbName=default, tableName=table_b9b31b57bb724b299b6000678ee9e5a4, message={"server":"","servicePrincipal":"","db":"default","table":"table_24faf39307584530a038ed30536bd4c2","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_24faf39307584530a038ed30536bd4c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_24faf39307584530a038ed30536bd4c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_24faf39307584530a038ed30536bd4c2\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_b9b31b57bb724b299b6000678ee9e5a4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b9b31b57bb724b299b6000678ee9e5a4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b9b31b57bb724b299b6000678ee9e5a4\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1777752049}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_8ad450efb0df42d2bb35c3f8d3e0b78e, message={"server":"","servicePrincipal":"","db":"default","table":"table_8ad450efb0df42d2bb35c3f8d3e0b78e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752049},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_8ad450efb0df42d2bb35c3f8d3e0b78e\",\"kudu.table_id\":\"7d9fa0bb8a9b4877b6bbbac853119f8d\",\"transient_lastDdlTime\":\"1777752049\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive);
I20260502 20:00:55.677788 12203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader b470a66ad54f46b1b44a80dd1edf214e. Latest consensus state: current_term: 6 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:55.677927 12203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: FOLLOWER
*** Check failure stack trace: ***
I20260502 20:00:55.678133 12238 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:55.678221 12238 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fcf53f5cdcd google::LogMessage::Fail() at ??:0
I20260502 20:00:55.681629 12236 mvcc.cc:204] Tried to move back new op lower bound from 7281672398071234560 to 7281672397815418880. Current Snapshot: MvccSnapshot[applied={T|T < 7281672398071234560 or (T in {7281672398071234560})}]
W20260502 20:00:55.682651 12011 consensus_peers.cc:597] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e -> Peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Couldn't send request to peer ef9294b460014382a2a594c77f8900d4. Status: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
@ 0x7fcf53f60b93 google::LogMessage::SendToLog() at ??:0
I20260502 20:00:55.684227 12235 mvcc.cc:204] Tried to move back new op lower bound from 7281672420014538752 to 7281672419737731072. Current Snapshot: MvccSnapshot[applied={T|T < 7281672420014538752}]
I20260502 20:00:55.684834 12227 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:55.684952 12227 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: LEADER
@ 0x7fcf53f5c7cc google::LogMessage::Flush() at ??:0
I20260502 20:00:55.686705 12238 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:55.686849 12238 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fcf53f5ca11 google::LogMessage::~LogMessage() at ??:0
I20260502 20:00:55.691514 12024 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet 35074187f6b140ea888ef0f2a692bb93
I20260502 20:00:55.691835 12025 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet aa0b66d220bf46fe853b2f03778b2096
I20260502 20:00:55.692080 12023 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42316:
table { table_name: "default.Table_ae16bd7eeae84bcc9df91b677d29e577" } modify_external_catalogs: true
I20260502 20:00:55.692260 12023 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42316:
table { table_name: "default.Table_ae16bd7eeae84bcc9df91b677d29e577" } modify_external_catalogs: true
I20260502 20:00:55.692375 12027 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet db76c47bb09042b5ac706c4b80fc3bb9
I20260502 20:00:55.693043 12025 catalog_manager.cc:6741] ReplaceTablet: tablet aa0b66d220bf46fe853b2f03778b2096 deleted and replaced by tablet 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:00:55.693264 12025 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42316:
table { table_name: "default.Table_24faf39307584530a038ed30536bd4c2" } new_table_name: "default.Table_b9b31b57bb724b299b6000678ee9e5a4" modify_external_catalogs: true
I20260502 20:00:55.693043 12027 catalog_manager.cc:6741] ReplaceTablet: tablet db76c47bb09042b5ac706c4b80fc3bb9 deleted and replaced by tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a
I20260502 20:00:55.693886 12027 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42316:
table { table_name: "default.Table_115178421c134252971c7a71b1134464" } new_table_name: "default.Table_9b0b95067a6444d783041819f979eb27" modify_external_catalogs: true
I20260502 20:00:55.694617 12026 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet 3ab25bb12883434cace35c4170dbc2e5
I20260502 20:00:55.695016 12026 catalog_manager.cc:6741] ReplaceTablet: tablet 3ab25bb12883434cace35c4170dbc2e5 deleted and replaced by tablet 13960950103845d7a83411bbf67c62a0
I20260502 20:00:55.695210 12026 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42316:
name: "default.Table_c1f90f27e25c436bb0c43af980cece1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:55.695775 12024 catalog_manager.cc:6741] ReplaceTablet: tablet 35074187f6b140ea888ef0f2a692bb93 deleted and replaced by tablet 029a4177bfc64776b461dadc4da2c743
I20260502 20:00:55.695972 12024 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42316:
name: "default.Table_89adbf9d323b449db6deb0fa830829bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7fcf594d0433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 20:00:55.702179 10973 tablet_service.cc:1558] Processing DeleteTablet for tablet db76c47bb09042b5ac706c4b80fc3bb9 with delete_type TABLET_DATA_DELETED (replaced by tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a) from {username='slave'} at 127.0.0.1:36992
I20260502 20:00:55.702471 10974 tablet_service.cc:1558] Processing DeleteTablet for tablet 35074187f6b140ea888ef0f2a692bb93 with delete_type TABLET_DATA_DELETED (replaced by tablet 029a4177bfc64776b461dadc4da2c743) from {username='slave'} at 127.0.0.1:36992
I20260502 20:00:55.702584 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet aa0b66d220bf46fe853b2f03778b2096 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d4b56bf7bac4ec7840e05107fd49caa) from {username='slave'} at 127.0.0.1:36992
I20260502 20:00:55.702668 10976 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ab25bb12883434cace35c4170dbc2e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 13960950103845d7a83411bbf67c62a0) from {username='slave'} at 127.0.0.1:36992
I20260502 20:00:55.702869 12253 tablet_replica.cc:333] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:55.703166 12253 raft_consensus.cc:2243] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:55.703305 12253 raft_consensus.cc:2272] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:55.703689 12253 ts_tablet_manager.cc:1916] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:55.705722 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 7d4b56bf7bac4ec7840e05107fd49caa (DEFAULT_TABLE table=default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:55.706027 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d4b56bf7bac4ec7840e05107fd49caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:55.706480 10977 tablet_service.cc:1511] Processing CreateTablet for tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a (DEFAULT_TABLE table=default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:55.706732 10977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:55.707252 12253 ts_tablet_manager.cc:1929] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:55.707317 12253 log.cc:1199] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/db76c47bb09042b5ac706c4b80fc3bb9
I20260502 20:00:55.707489 11110 tablet_service.cc:1558] Processing DeleteTablet for tablet db76c47bb09042b5ac706c4b80fc3bb9 with delete_type TABLET_DATA_DELETED (replaced by tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a) from {username='slave'} at 127.0.0.1:34170
I20260502 20:00:55.707592 12253 ts_tablet_manager.cc:1950] T db76c47bb09042b5ac706c4b80fc3bb9 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:55.707734 11112 tablet_service.cc:1558] Processing DeleteTablet for tablet aa0b66d220bf46fe853b2f03778b2096 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d4b56bf7bac4ec7840e05107fd49caa) from {username='slave'} at 127.0.0.1:34170
I20260502 20:00:55.707825 11109 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ab25bb12883434cace35c4170dbc2e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 13960950103845d7a83411bbf67c62a0) from {username='slave'} at 127.0.0.1:34170
I20260502 20:00:55.707947 11108 tablet_service.cc:1558] Processing DeleteTablet for tablet 35074187f6b140ea888ef0f2a692bb93 with delete_type TABLET_DATA_DELETED (replaced by tablet 029a4177bfc64776b461dadc4da2c743) from {username='slave'} at 127.0.0.1:34170
I20260502 20:00:55.708045 11107 tablet_service.cc:1511] Processing CreateTablet for tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a (DEFAULT_TABLE table=default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:55.708249 12253 tablet_replica.cc:333] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:55.708277 11107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:55.708362 12253 raft_consensus.cc:2243] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:55.708460 12253 raft_consensus.cc:2272] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:55.708799 12253 ts_tablet_manager.cc:1916] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:55.708982 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 029a4177bfc64776b461dadc4da2c743 (DEFAULT_TABLE table=default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:55.709233 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029a4177bfc64776b461dadc4da2c743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:55.710662 12253 ts_tablet_manager.cc:1929] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:55.710727 12253 log.cc:1199] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/35074187f6b140ea888ef0f2a692bb93
I20260502 20:00:55.710707 11110 tablet_service.cc:1511] Processing CreateTablet for tablet 029a4177bfc64776b461dadc4da2c743 (DEFAULT_TABLE table=default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:55.710963 11110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029a4177bfc64776b461dadc4da2c743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:55.711054 12253 ts_tablet_manager.cc:1950] T 35074187f6b140ea888ef0f2a692bb93 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:55.711357 11111 tablet_service.cc:1511] Processing CreateTablet for tablet 7d4b56bf7bac4ec7840e05107fd49caa (DEFAULT_TABLE table=default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:55.711544 11111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d4b56bf7bac4ec7840e05107fd49caa. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fcf594cf34a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 20:00:55.712873 12257 tablet_bootstrap.cc:492] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:55.713737 12011 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet db76c47bb09042b5ac706c4b80fc3bb9 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]) successfully deleted
I20260502 20:00:55.713877 12257 tablet_bootstrap.cc:654] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:55.714502 12255 tablet_replica.cc:333] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:55.714614 12255 raft_consensus.cc:2243] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:55.714869 12255 raft_consensus.cc:2272] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:55.715165 12253 tablet_replica.cc:333] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:55.715327 12255 ts_tablet_manager.cc:1916] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:55.715330 12253 raft_consensus.cc:2243] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
@ 0x7fcf594ceaad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 20:00:55.715449 12253 raft_consensus.cc:2272] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:55.715832 12253 ts_tablet_manager.cc:1916] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:55.716018 12011 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet 35074187f6b140ea888ef0f2a692bb93 (table default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]) successfully deleted
I20260502 20:00:55.716399 11111 tablet_service.cc:1511] Processing CreateTablet for tablet 13960950103845d7a83411bbf67c62a0 (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:55.716617 11111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13960950103845d7a83411bbf67c62a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:55.717422 12255 ts_tablet_manager.cc:1929] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:55.717487 12255 log.cc:1199] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/db76c47bb09042b5ac706c4b80fc3bb9
I20260502 20:00:55.717749 12255 ts_tablet_manager.cc:1950] T db76c47bb09042b5ac706c4b80fc3bb9 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:55.718077 12253 ts_tablet_manager.cc:1929] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:55.718148 12253 log.cc:1199] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/aa0b66d220bf46fe853b2f03778b2096
I20260502 20:00:55.718427 12253 ts_tablet_manager.cc:1950] T aa0b66d220bf46fe853b2f03778b2096 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:55.718811 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 13960950103845d7a83411bbf67c62a0 (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7fcf594d41b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260502 20:00:55.719183 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13960950103845d7a83411bbf67c62a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:55.719508 12253 tablet_replica.cc:333] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:55.719667 12253 raft_consensus.cc:2243] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:55.719785 12253 raft_consensus.cc:2272] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x56036e242244 std::function<>::operator()() at ??:0
I20260502 20:00:55.720177 12253 ts_tablet_manager.cc:1916] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:55.721168 12011 catalog_manager.cc:5002] TS 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): tablet aa0b66d220bf46fe853b2f03778b2096 (table default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b]) successfully deleted
I20260502 20:00:55.721650 12255 tablet_replica.cc:333] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:55.721783 12255 raft_consensus.cc:2243] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:55.721765 12014 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet db76c47bb09042b5ac706c4b80fc3bb9 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]) successfully deleted
I20260502 20:00:55.721972 12255 raft_consensus.cc:2272] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:55.722329 12255 ts_tablet_manager.cc:1916] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fcf554617ea kudu::Thread::SuperviseThread() at ??:0
I20260502 20:00:55.723613 11249 tablet_service.cc:1558] Processing DeleteTablet for tablet 35074187f6b140ea888ef0f2a692bb93 with delete_type TABLET_DATA_DELETED (replaced by tablet 029a4177bfc64776b461dadc4da2c743) from {username='slave'} at 127.0.0.1:46950
I20260502 20:00:55.723690 11248 tablet_service.cc:1511] Processing CreateTablet for tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a (DEFAULT_TABLE table=default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:55.723819 12253 ts_tablet_manager.cc:1929] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:55.723891 12253 log.cc:1199] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/3ab25bb12883434cace35c4170dbc2e5
I20260502 20:00:55.723878 11250 tablet_service.cc:1558] Processing DeleteTablet for tablet db76c47bb09042b5ac706c4b80fc3bb9 with delete_type TABLET_DATA_DELETED (replaced by tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a) from {username='slave'} at 127.0.0.1:46950
I20260502 20:00:55.723953 11248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:55.723994 11253 tablet_service.cc:1558] Processing DeleteTablet for tablet aa0b66d220bf46fe853b2f03778b2096 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d4b56bf7bac4ec7840e05107fd49caa) from {username='slave'} at 127.0.0.1:46950
I20260502 20:00:55.724085 11251 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ab25bb12883434cace35c4170dbc2e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 13960950103845d7a83411bbf67c62a0) from {username='slave'} at 127.0.0.1:46950
I20260502 20:00:55.724148 12253 ts_tablet_manager.cc:1950] T 3ab25bb12883434cace35c4170dbc2e5 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:55.724310 11252 tablet_service.cc:1511] Processing CreateTablet for tablet 7d4b56bf7bac4ec7840e05107fd49caa (DEFAULT_TABLE table=default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:55.724596 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d4b56bf7bac4ec7840e05107fd49caa. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fcf55da56db start_thread at ??:0
I20260502 20:00:55.727093 11247 tablet_service.cc:1511] Processing CreateTablet for tablet 029a4177bfc64776b461dadc4da2c743 (DEFAULT_TABLE table=default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:55.727382 11247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 029a4177bfc64776b461dadc4da2c743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:55.727958 12257 tablet_bootstrap.cc:492] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:55.728173 12257 ts_tablet_manager.cc:1403] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
@ 0x7fcf5311361f clone at ??:0
I20260502 20:00:55.729493 12257 raft_consensus.cc:359] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.729621 12257 raft_consensus.cc:385] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:55.729656 12257 raft_consensus.cc:740] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:55.729800 12257 consensus_queue.cc:260] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.730021 11246 tablet_service.cc:1511] Processing CreateTablet for tablet 13960950103845d7a83411bbf67c62a0 (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:55.730284 11246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13960950103845d7a83411bbf67c62a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:55.731002 12255 ts_tablet_manager.cc:1929] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:55.731068 12255 log.cc:1199] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/aa0b66d220bf46fe853b2f03778b2096
I20260502 20:00:55.731336 12255 ts_tablet_manager.cc:1950] T aa0b66d220bf46fe853b2f03778b2096 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:55.731544 12256 tablet_bootstrap.cc:492] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:55.731850 12257 ts_tablet_manager.cc:1434] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260502 20:00:55.732048 12257 tablet_bootstrap.cc:492] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:55.732523 12260 tablet_bootstrap.cc:492] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:55.732836 12256 tablet_bootstrap.cc:654] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:55.733027 12257 tablet_bootstrap.cc:654] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:55.733537 12259 tablet_replica.cc:333] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:55.733690 12259 raft_consensus.cc:2243] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:55.734161 12255 tablet_replica.cc:333] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:55.734310 12255 raft_consensus.cc:2243] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:55.734506 12255 raft_consensus.cc:2272] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:55.734865 12255 ts_tablet_manager.cc:1916] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:55.734920 12257 tablet_bootstrap.cc:492] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:55.735006 12257 ts_tablet_manager.cc:1403] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:55.735070 12259 raft_consensus.cc:2272] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:55.735416 12259 ts_tablet_manager.cc:1916] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:55.735435 12257 raft_consensus.cc:359] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.735522 12257 raft_consensus.cc:385] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:55.735550 12257 raft_consensus.cc:740] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:55.735786 12257 consensus_queue.cc:260] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.736923 12255 ts_tablet_manager.cc:1929] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:55.736979 12255 log.cc:1199] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/3ab25bb12883434cace35c4170dbc2e5
I20260502 20:00:55.737228 12255 ts_tablet_manager.cc:1950] T 3ab25bb12883434cace35c4170dbc2e5 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:55.737296 12259 ts_tablet_manager.cc:1929] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:55.737785 12256 tablet_bootstrap.cc:492] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:55.737866 12256 ts_tablet_manager.cc:1403] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260502 20:00:55.737903 12255 tablet_replica.cc:333] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:55.738013 12255 raft_consensus.cc:2243] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:55.738161 12255 raft_consensus.cc:2272] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:55.738205 12257 ts_tablet_manager.cc:1434] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260502 20:00:55.738353 12256 raft_consensus.cc:359] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.739271 12256 raft_consensus.cc:385] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:55.739315 12256 raft_consensus.cc:740] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:55.739461 12256 consensus_queue.cc:260] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.739705 12256 ts_tablet_manager.cc:1434] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 20:00:55.739827 12259 log.cc:1199] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/35074187f6b140ea888ef0f2a692bb93
I20260502 20:00:55.740109 12259 ts_tablet_manager.cc:1950] T 35074187f6b140ea888ef0f2a692bb93 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:55.740716 12259 tablet_replica.cc:333] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:55.740820 12259 raft_consensus.cc:2243] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:55.740903 12259 raft_consensus.cc:2272] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:55.741215 12259 ts_tablet_manager.cc:1916] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:55.741778 12257 tablet_bootstrap.cc:492] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:55.742874 12257 tablet_bootstrap.cc:654] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:55.742911 12259 ts_tablet_manager.cc:1929] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:55.743000 12259 log.cc:1199] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/db76c47bb09042b5ac706c4b80fc3bb9
I20260502 20:00:55.743232 12259 ts_tablet_manager.cc:1950] T db76c47bb09042b5ac706c4b80fc3bb9 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:55.737464 12260 tablet_bootstrap.cc:654] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:55.744400 12255 ts_tablet_manager.cc:1916] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:55.746256 12255 ts_tablet_manager.cc:1929] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:55.746318 12255 log.cc:1199] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/35074187f6b140ea888ef0f2a692bb93
I20260502 20:00:55.747496 12259 tablet_replica.cc:333] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:55.747615 12259 raft_consensus.cc:2243] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:55.747706 12259 raft_consensus.cc:2272] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:55.747695 12256 tablet_bootstrap.cc:492] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:55.748028 12259 ts_tablet_manager.cc:1916] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:55.748104 11976 raft_consensus.cc:493] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:55.748188 11976 raft_consensus.cc:515] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.748544 11976 leader_election.cc:290] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:55.749027 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029a4177bfc64776b461dadc4da2c743" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:55.749478 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029a4177bfc64776b461dadc4da2c743" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
W20260502 20:00:55.749580 11065 leader_election.cc:343] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Illegal state: must be running to vote when last-logged opid is not known
W20260502 20:00:55.749852 11065 leader_election.cc:343] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Illegal state: must be running to vote when last-logged opid is not known
I20260502 20:00:55.749925 11065 leader_election.cc:304] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b85d150f168f406bb31ff44150b2b1a1; no voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72
I20260502 20:00:55.749953 12255 ts_tablet_manager.cc:1950] T 35074187f6b140ea888ef0f2a692bb93 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:55.750134 11976 raft_consensus.cc:2749] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 20:00:55.751048 12259 ts_tablet_manager.cc:1929] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:55.751108 12259 log.cc:1199] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/aa0b66d220bf46fe853b2f03778b2096
I20260502 20:00:55.751334 12259 ts_tablet_manager.cc:1950] T aa0b66d220bf46fe853b2f03778b2096 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:55.752164 12259 tablet_replica.cc:333] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:55.752287 12259 raft_consensus.cc:2243] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:55.752382 12259 raft_consensus.cc:2272] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:55.752703 12259 ts_tablet_manager.cc:1916] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:55.751277 12256 tablet_bootstrap.cc:654] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:55.754518 12259 ts_tablet_manager.cc:1929] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:55.754575 12259 log.cc:1199] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/3ab25bb12883434cace35c4170dbc2e5
I20260502 20:00:55.754797 12259 ts_tablet_manager.cc:1950] T 3ab25bb12883434cace35c4170dbc2e5 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:55.756045 12260 tablet_bootstrap.cc:492] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:55.756122 12260 ts_tablet_manager.cc:1403] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20260502 20:00:55.756171 12257 tablet_bootstrap.cc:492] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:55.756266 12257 ts_tablet_manager.cc:1403] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20260502 20:00:55.756544 12260 raft_consensus.cc:359] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.756632 12260 raft_consensus.cc:385] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:55.756659 12260 raft_consensus.cc:740] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:55.756793 12260 consensus_queue.cc:260] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.756935 12257 raft_consensus.cc:359] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.757037 12260 ts_tablet_manager.cc:1434] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:55.757067 12257 raft_consensus.cc:385] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:55.757105 12257 raft_consensus.cc:740] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:55.757225 12260 tablet_bootstrap.cc:492] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:55.757268 12257 consensus_queue.cc:260] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.757583 12257 ts_tablet_manager.cc:1434] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:00:55.758284 12260 tablet_bootstrap.cc:654] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:55.759675 12260 tablet_bootstrap.cc:492] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:55.759753 12260 ts_tablet_manager.cc:1403] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:55.760028 12257 tablet_bootstrap.cc:492] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:55.760217 12260 raft_consensus.cc:359] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.760324 12260 raft_consensus.cc:385] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:55.760355 12260 raft_consensus.cc:740] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:55.760469 12260 consensus_queue.cc:260] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.760756 12260 ts_tablet_manager.cc:1434] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:55.760902 12260 tablet_bootstrap.cc:492] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:55.761063 12257 tablet_bootstrap.cc:654] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:55.761893 12260 tablet_bootstrap.cc:654] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:55.762310 12256 tablet_bootstrap.cc:492] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:55.762408 12256 ts_tablet_manager.cc:1403] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260502 20:00:55.762993 12256 raft_consensus.cc:359] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.763106 12256 raft_consensus.cc:385] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:55.763140 12256 raft_consensus.cc:740] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:55.763427 12256 consensus_queue.cc:260] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.763708 12256 ts_tablet_manager.cc:1434] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:55.764485 12256 tablet_bootstrap.cc:492] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:55.764671 12257 tablet_bootstrap.cc:492] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:55.764755 12257 ts_tablet_manager.cc:1403] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260502 20:00:55.765211 12257 raft_consensus.cc:359] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.765328 12257 raft_consensus.cc:385] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:55.765365 12257 raft_consensus.cc:740] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:55.765467 12257 consensus_queue.cc:260] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.765592 12256 tablet_bootstrap.cc:654] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:55.765780 12257 ts_tablet_manager.cc:1434] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:00:55.767359 12260 tablet_bootstrap.cc:492] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:55.767441 12260 ts_tablet_manager.cc:1403] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260502 20:00:55.768090 12260 raft_consensus.cc:359] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.768201 12260 raft_consensus.cc:385] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:55.768232 12260 raft_consensus.cc:740] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:55.768710 12260 consensus_queue.cc:260] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.769438 12256 tablet_bootstrap.cc:492] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:55.769541 12256 ts_tablet_manager.cc:1403] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260502 20:00:55.769846 12260 ts_tablet_manager.cc:1434] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260502 20:00:55.770020 12260 tablet_bootstrap.cc:492] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:55.772089 12260 tablet_bootstrap.cc:654] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:55.773473 12260 tablet_bootstrap.cc:492] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:55.773550 12260 ts_tablet_manager.cc:1403] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 20:00:55.771037 12256 raft_consensus.cc:359] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.773638 12256 raft_consensus.cc:385] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:55.773699 12256 raft_consensus.cc:740] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:55.773840 12256 consensus_queue.cc:260] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.773972 12260 raft_consensus.cc:359] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.774070 12260 raft_consensus.cc:385] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:55.774101 12260 raft_consensus.cc:740] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:55.774235 12260 consensus_queue.cc:260] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.774530 12260 ts_tablet_manager.cc:1434] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:55.777588 12256 ts_tablet_manager.cc:1434] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260502 20:00:55.778184 12256 tablet_bootstrap.cc:492] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:55.780046 12256 tablet_bootstrap.cc:654] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:55.781325 12256 tablet_bootstrap.cc:492] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:55.781412 12256 ts_tablet_manager.cc:1403] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:55.781885 12256 raft_consensus.cc:359] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.781991 12256 raft_consensus.cc:385] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:55.782027 12256 raft_consensus.cc:740] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:55.782158 12256 consensus_queue.cc:260] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.782276 12067 raft_consensus.cc:493] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:55.782375 12067 raft_consensus.cc:515] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.782817 12067 leader_election.cc:290] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:55.783269 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13960950103845d7a83411bbf67c62a0" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:55.783409 11131 raft_consensus.cc:2468] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:55.783488 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13960950103845d7a83411bbf67c62a0" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:55.783633 11272 raft_consensus.cc:2468] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:55.783926 10933 leader_election.cc:304] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:55.784171 12067 raft_consensus.cc:2804] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:55.784236 12067 raft_consensus.cc:493] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:55.784278 12067 raft_consensus.cc:3060] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:55.784885 12256 ts_tablet_manager.cc:1434] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:55.785354 12067 raft_consensus.cc:515] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.785735 12067 leader_election.cc:290] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:55.786017 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13960950103845d7a83411bbf67c62a0" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:55.786114 11131 raft_consensus.cc:3060] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:55.786557 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13960950103845d7a83411bbf67c62a0" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:55.786662 11272 raft_consensus.cc:3060] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:55.787276 11131 raft_consensus.cc:2468] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:55.787575 10933 leader_election.cc:304] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:55.787729 11272 raft_consensus.cc:2468] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:55.787756 12067 raft_consensus.cc:2804] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:55.787882 12067 raft_consensus.cc:697] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:55.788060 12067 consensus_queue.cc:237] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.867337 11987 raft_consensus.cc:493] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:55.867476 11987 raft_consensus.cc:515] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.868026 11987 leader_election.cc:290] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:55.868539 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee63c93d1c47b7b1d61c5a2c7fae1a" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:55.868573 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee63c93d1c47b7b1d61c5a2c7fae1a" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:55.868703 11131 raft_consensus.cc:2468] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:55.868752 10982 raft_consensus.cc:2468] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:55.869063 11209 leader_election.cc:304] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:55.869287 11987 raft_consensus.cc:2804] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:55.869343 11987 raft_consensus.cc:493] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:55.869392 11987 raft_consensus.cc:3060] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:55.870272 11987 raft_consensus.cc:515] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.870672 11987 leader_election.cc:290] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:55.871086 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee63c93d1c47b7b1d61c5a2c7fae1a" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:55.871076 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ee63c93d1c47b7b1d61c5a2c7fae1a" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:55.871222 10982 raft_consensus.cc:3060] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:55.871273 11131 raft_consensus.cc:3060] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:55.872237 11131 raft_consensus.cc:2468] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:55.872241 10982 raft_consensus.cc:2468] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:55.872537 11206 leader_election.cc:304] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:55.872701 11987 raft_consensus.cc:2804] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:55.872925 11987 raft_consensus.cc:697] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Becoming Leader. State: Replica: ade741c4062940adb2223b55187ffe72, State: Running, Role: LEADER
I20260502 20:00:55.873080 11987 consensus_queue.cc:237] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.892679 12280 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:55.892853 12280 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.893431 12280 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:55.893945 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4b56bf7bac4ec7840e05107fd49caa" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:55.893949 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4b56bf7bac4ec7840e05107fd49caa" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:55.894119 11272 raft_consensus.cc:2468] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:55.894476 10930 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:55.894099 11131 raft_consensus.cc:2468] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:55.895130 12280 raft_consensus.cc:2804] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:55.895205 12280 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:55.895259 12280 raft_consensus.cc:3060] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:55.896584 12280 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:55.898288 12280 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:55.898264 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4b56bf7bac4ec7840e05107fd49caa" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:55.898393 11131 raft_consensus.cc:3060] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:55.898774 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d4b56bf7bac4ec7840e05107fd49caa" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:55.898954 11272 raft_consensus.cc:3060] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:55.899734 11131 raft_consensus.cc:2468] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:55.900043 11272 raft_consensus.cc:2468] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:55.900259 10933 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:55.900534 12280 raft_consensus.cc:2804] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:55.900647 12280 raft_consensus.cc:697] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:55.900830 12280 consensus_queue.cc:237] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
W20260502 20:00:55.927628 10932 connection.cc:570] server connection from 127.0.0.1:36992 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:55.927639 11067 connection.cc:570] server connection from 127.0.0.1:34170 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:55.927628 11209 connection.cc:570] server connection from 127.0.0.1:46950 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:55.927999 11208 connection.cc:570] client connection to 127.10.27.188:33369 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:55.928090 11067 connection.cc:570] client connection to 127.10.27.188:33369 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:55.928789 10932 connection.cc:570] client connection to 127.10.27.188:33369 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:55.929276 12226 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 20:00:55.928774 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.10.27.188:33369 (local address 127.10.27.131:58127)
0502 20:00:55.929070 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0502 20:00:55.929088 (+ 18us) client_negotiation.cc:175] Beginning negotiation
0502 20:00:55.929158 (+ 70us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":176}
W20260502 20:00:55.929625 11328 connection.cc:570] client connection to 127.10.27.188:33369 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:55.930019 11328 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.10.27.188:33369)
W20260502 20:00:55.930137 12223 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 20:00:55.928815 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.10.27.188:33369 (local address 127.10.27.130:34681)
0502 20:00:55.929501 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0502 20:00:55.929558 (+ 57us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":597}
W20260502 20:00:55.930365 11328 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.27.188:33369)
W20260502 20:00:55.930464 11328 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.10.27.188:33369)
W20260502 20:00:55.930979 11328 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.10.27.188:33369)
I20260502 20:00:56.023841 12280 raft_consensus.cc:493] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:56.024036 12280 raft_consensus.cc:515] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:56.024531 12280 leader_election.cc:290] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:56.025029 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029a4177bfc64776b461dadc4da2c743" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:56.025040 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029a4177bfc64776b461dadc4da2c743" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:56.025161 11131 raft_consensus.cc:2468] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:56.025281 11272 raft_consensus.cc:2468] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:56.025557 10933 leader_election.cc:304] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:56.025784 12280 raft_consensus.cc:2804] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:56.025847 12280 raft_consensus.cc:493] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:56.025907 12280 raft_consensus.cc:3060] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:56.026755 12280 raft_consensus.cc:515] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:56.027195 12280 leader_election.cc:290] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:56.027627 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029a4177bfc64776b461dadc4da2c743" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:56.027699 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "029a4177bfc64776b461dadc4da2c743" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:56.027776 11131 raft_consensus.cc:3060] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:56.027809 11272 raft_consensus.cc:3060] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:56.028832 11272 raft_consensus.cc:2468] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:56.028832 11131 raft_consensus.cc:2468] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:56.029264 10933 leader_election.cc:304] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:56.029501 12280 raft_consensus.cc:2804] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:56.029618 12280 raft_consensus.cc:697] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:56.029805 12280 consensus_queue.cc:237] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:56.212440 12290 raft_consensus.cc:493] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:00:56.212579 12290 raft_consensus.cc:515] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:56.213982 12290 leader_election.cc:290] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:00:56.214617 12147 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:00:56.215647 12147 leader_election.cc:336] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:00:56.215746 12149 leader_election.cc:336] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
I20260502 20:00:56.215823 12149 leader_election.cc:304] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38315e4f56484666b5e54afad02498ec; no voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4
I20260502 20:00:56.216019 12290 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260502 20:00:56.325305 12280 consensus_queue.cc:1048] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:56.331060 12067 consensus_queue.cc:1048] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:56.416535 12297 consensus_queue.cc:1048] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:56.420475 12297 consensus_queue.cc:1048] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:56.451272 12304 consensus_queue.cc:1048] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:56.456199 12304 consensus_queue.cc:1048] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:56.490553 12297 consensus_queue.cc:1048] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:56.494797 12280 consensus_queue.cc:1048] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:56.857406 12311 raft_consensus.cc:493] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:00:56.857568 12311 raft_consensus.cc:515] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:56.858037 12311 leader_election.cc:290] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:00:56.859675 12149 leader_election.cc:336] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
W20260502 20:00:56.859778 12147 leader_election.cc:336] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:00:56.859844 12147 leader_election.cc:304] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38315e4f56484666b5e54afad02498ec; no voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4
I20260502 20:00:56.859977 12311 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260502 20:00:57.743065 12324 raft_consensus.cc:493] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:00:57.743192 12324 raft_consensus.cc:515] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:57.743687 12324 leader_election.cc:290] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:00:57.744939 12147 leader_election.cc:336] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:00:57.745085 12149 leader_election.cc:336] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
I20260502 20:00:57.745146 12149 leader_election.cc:304] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 38315e4f56484666b5e54afad02498ec; no voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4
I20260502 20:00:57.745285 12324 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260502 20:00:58.489200 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.189:46281
--webserver_interface=127.10.27.189
--webserver_port=43275
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 20:00:58.610060 12337 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:00:58.610345 12337 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:00:58.610433 12337 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:00:58.613935 12337 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 20:00:58.614043 12337 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:00:58.614082 12337 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 20:00:58.614144 12337 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 20:00:58.618295 12337 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.189:46281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.27.189
--webserver_port=43275
--never_fsync=true
--heap_profile_path=/tmp/kudu.12337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:00:58.619524 12337 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:00:58.620699 12337 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:00:58.628198 12346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:58.628281 12349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:00:58.628198 12347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:00:58.628525 12337 server_base.cc:1061] running on GCE node
I20260502 20:00:58.629403 12337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:00:58.630496 12337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:00:58.631738 12337 hybrid_clock.cc:648] HybridClock initialized: now 1777752058631717 us; error 48 us; skew 500 ppm
I20260502 20:00:58.634089 12337 webserver.cc:492] Webserver started at http://127.10.27.189:43275/ using document root <none> and password file <none>
I20260502 20:00:58.634800 12337 fs_manager.cc:362] Metadata directory not provided
I20260502 20:00:58.634902 12337 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:00:58.638857 12337 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.000s sys 0.002s
I20260502 20:00:58.641316 12355 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:00:58.642470 12337 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260502 20:00:58.642617 12337 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
uuid: "ef9294b460014382a2a594c77f8900d4"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:00:58.643111 12337 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:00:58.657112 12337 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:00:58.657846 12337 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:00:58.658062 12337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:00:58.665494 12337 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.189:46281
I20260502 20:00:58.665508 12407 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.189:46281 every 8 connection(s)
I20260502 20:00:58.666602 12337 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
I20260502 20:00:58.670775 12408 sys_catalog.cc:263] Verifying existing consensus state
I20260502 20:00:58.672504 12408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Bootstrap starting.
I20260502 20:00:58.676789 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 12337
I20260502 20:00:58.685665 12408 log.cc:826] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Log is configured to *not* fsync() on all Append() calls
I20260502 20:00:58.743873 12408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Bootstrap replayed 1/1 log segments. Stats: ops{read=113 overwritten=0 applied=113 ignored=0} inserts{seen=67 ignored=0} mutations{seen=97 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:00:58.744391 12408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Bootstrap complete.
I20260502 20:00:58.747999 12408 raft_consensus.cc:359] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:58.748426 12408 raft_consensus.cc:740] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9294b460014382a2a594c77f8900d4, State: Initialized, Role: FOLLOWER
I20260502 20:00:58.748893 12408 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 113, Last appended: 5.113, Last appended by leader: 113, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:58.749403 12412 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:58.749550 12412 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:58.750058 12408 sys_catalog.cc:565] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260502 20:00:58.757790 12426 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:00:58.757884 12426 catalog_manager.cc:1562] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: loading cluster ID for follower catalog manager: success
I20260502 20:00:58.761049 12426 catalog_manager.cc:1584] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: acquiring CA information for follower catalog manager: success
I20260502 20:00:58.763075 12426 catalog_manager.cc:1612] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 20:00:58.776008 12337 master_runner.cc:186] Error getting master registration for 127.10.27.188:33369: Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111),
I20260502 20:00:58.778085 12337 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:00:58.887508 11321 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:00:58.889573 12371 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ade741c4062940adb2223b55187ffe72" instance_seqno: 1777752043938024) as {username='slave'} at 127.10.27.131:51305; Asking this server to re-register.
I20260502 20:00:58.890224 11321 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:58.891742 12371 ts_manager.cc:194] Registered new tserver with Master: ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:58.925367 12433 raft_consensus.cc:493] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:00:58.925506 12433 raft_consensus.cc:515] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:58.926052 12433 leader_election.cc:290] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:00:58.927965 12149 leader_election.cc:336] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
I20260502 20:00:58.931068 12382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38315e4f56484666b5e54afad02498ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 120 } } ignore_live_leader: false dest_uuid: "ef9294b460014382a2a594c77f8900d4" is_pre_election: true
I20260502 20:00:58.931548 12382 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38315e4f56484666b5e54afad02498ec in term 5.
I20260502 20:00:58.932067 12147 leader_election.cc:304] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4; no voters: b470a66ad54f46b1b44a80dd1edf214e
I20260502 20:00:58.932341 12433 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260502 20:00:58.932440 12433 raft_consensus.cc:493] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:00:58.932504 12433 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 6 FOLLOWER]: Advancing to term 7
I20260502 20:00:58.933673 12433 raft_consensus.cc:515] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:58.934099 12433 leader_election.cc:290] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 election: Requested vote from peers ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
I20260502 20:00:58.934468 12382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38315e4f56484666b5e54afad02498ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 120 } } ignore_live_leader: false dest_uuid: "ef9294b460014382a2a594c77f8900d4"
I20260502 20:00:58.934594 12382 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 5 FOLLOWER]: Advancing to term 7
W20260502 20:00:58.935257 12149 leader_election.cc:336] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
I20260502 20:00:58.936964 12382 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38315e4f56484666b5e54afad02498ec in term 7.
I20260502 20:00:58.937460 12147 leader_election.cc:304] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4; no voters: b470a66ad54f46b1b44a80dd1edf214e
I20260502 20:00:58.937722 12433 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 7 FOLLOWER]: Leader election won for term 7
I20260502 20:00:58.937999 12433 raft_consensus.cc:697] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [term 7 LEADER]: Becoming Leader. State: Replica: 38315e4f56484666b5e54afad02498ec, State: Running, Role: LEADER
I20260502 20:00:58.938386 12433 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 6.120, Last appended by leader: 120, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:58.939590 12438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38315e4f56484666b5e54afad02498ec. Latest consensus state: current_term: 7 leader_uuid: "38315e4f56484666b5e54afad02498ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:58.939733 12438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:58.940132 12440 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 20:00:58.942008 12440 catalog_manager.cc:679] Loaded metadata for table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc]
I20260502 20:00:58.942390 12440 catalog_manager.cc:679] Loaded metadata for table default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]
I20260502 20:00:58.942636 12440 catalog_manager.cc:679] Loaded metadata for table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]
I20260502 20:00:58.942888 12440 catalog_manager.cc:679] Loaded metadata for table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]
I20260502 20:00:58.943254 12440 catalog_manager.cc:679] Loaded metadata for table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]
I20260502 20:00:58.943500 12440 catalog_manager.cc:679] Loaded metadata for table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]
I20260502 20:00:58.943743 12440 catalog_manager.cc:679] Loaded metadata for table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]
I20260502 20:00:58.943985 12440 catalog_manager.cc:679] Loaded metadata for table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]
I20260502 20:00:58.944204 12440 catalog_manager.cc:679] Loaded metadata for table default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150]
I20260502 20:00:58.944622 12440 catalog_manager.cc:679] Loaded metadata for table default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]
I20260502 20:00:58.944842 12440 catalog_manager.cc:679] Loaded metadata for table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f]
I20260502 20:00:58.945071 12440 catalog_manager.cc:679] Loaded metadata for table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2]
I20260502 20:00:58.945291 12440 catalog_manager.cc:679] Loaded metadata for table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63]
I20260502 20:00:58.945648 12440 catalog_manager.cc:679] Loaded metadata for table default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b]
I20260502 20:00:58.945946 12440 catalog_manager.cc:679] Loaded metadata for table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]
I20260502 20:00:58.947594 12440 tablet_loader.cc:96] loaded metadata for tablet 029a4177bfc64776b461dadc4da2c743 (table default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee])
I20260502 20:00:58.947841 12440 tablet_loader.cc:96] loaded metadata for tablet 0ea263d32fd2405985d4514c2ff02a39 (table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f])
I20260502 20:00:58.948060 12440 tablet_loader.cc:96] loaded metadata for tablet 11548942c58f4c05bad32038a55b8f66 (table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63])
I20260502 20:00:58.948238 12440 tablet_loader.cc:96] loaded metadata for tablet 13960950103845d7a83411bbf67c62a0 (table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f])
I20260502 20:00:58.948613 12440 tablet_loader.cc:96] loaded metadata for tablet 34eaaaf6417a4e80b3409ea1fdcac25b (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b])
I20260502 20:00:58.948968 12440 tablet_loader.cc:96] loaded metadata for tablet 3cdb6695c99e4da682e33b146b0e51ab (table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86])
I20260502 20:00:58.949446 12440 tablet_loader.cc:96] loaded metadata for tablet 7d4b56bf7bac4ec7840e05107fd49caa (table default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b])
I20260502 20:00:58.950116 12440 tablet_loader.cc:96] loaded metadata for tablet 9df3ebd756b248d0b92bad3259e7a122 (table default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150])
I20260502 20:00:58.950377 12440 tablet_loader.cc:96] loaded metadata for tablet a18f3a9b1f514513a807d0a919db1f20 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760])
I20260502 20:00:58.950639 12440 tablet_loader.cc:96] loaded metadata for tablet af5837b307bb43258aa75c9a947dd5c6 (table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b])
I20260502 20:00:58.950806 12440 tablet_loader.cc:96] loaded metadata for tablet b3f6a9613e594f12b0e518d0b9d9e7ed (table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064])
I20260502 20:00:58.951334 12440 tablet_loader.cc:96] loaded metadata for tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464])
I20260502 20:00:58.951712 12440 tablet_loader.cc:96] loaded metadata for tablet c8e6be4db78c4544bca924bcbff3a4b9 (table default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02])
I20260502 20:00:58.952090 12440 tablet_loader.cc:96] loaded metadata for tablet e43e158d448442d3811dbdfe82db47ca (table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2])
I20260502 20:00:58.952575 12440 tablet_loader.cc:96] loaded metadata for tablet f6de313115d04ebebe7c481d640c260e (table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc])
I20260502 20:00:58.952888 12440 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 20:00:58.953740 12440 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:00:58.953799 12440 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 20:00:58.955130 12440 catalog_manager.cc:1514] Loading token signing keys...
I20260502 20:00:58.955837 12440 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Loaded TSK: 0
I20260502 20:00:58.956563 12440 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 20:00:58.957391 12440 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 20:00:58.958165 12440 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 24
I20260502 20:00:58.964067 12162 master_service.cc:954] ReplaceTablet: received request to replace tablet 029a4177bfc64776b461dadc4da2c743 from {username='slave'} at 127.0.0.1:39566
I20260502 20:00:58.964159 12161 master_service.cc:954] ReplaceTablet: received request to replace tablet 34eaaaf6417a4e80b3409ea1fdcac25b from {username='slave'} at 127.0.0.1:39566
I20260502 20:00:58.964439 12157 master_service.cc:954] ReplaceTablet: received request to replace tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a from {username='slave'} at 127.0.0.1:39566
I20260502 20:00:58.964638 12159 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39566:
table { table_name: "default.Table_ac5362bfe46a4090a35bd51ad90c59ad" } modify_external_catalogs: true
I20260502 20:00:58.964794 12159 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39566:
table { table_name: "default.Table_ac5362bfe46a4090a35bd51ad90c59ad" } modify_external_catalogs: true
I20260502 20:00:58.965565 12158 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39566:
name: "default.Table_2eef3c375d5248539d96b67ea8bbc2be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:58.965989 12156 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39566:
table { table_name: "default.Table_8f233da2ffa04623bc614dc8d7d8e51c" } modify_external_catalogs: true
I20260502 20:00:58.966099 12156 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39566:
table { table_name: "default.Table_8f233da2ffa04623bc614dc8d7d8e51c" } modify_external_catalogs: true
I20260502 20:00:58.966225 12160 master_service.cc:954] ReplaceTablet: received request to replace tablet c8e6be4db78c4544bca924bcbff3a4b9 from {username='slave'} at 127.0.0.1:39566
I20260502 20:00:58.966274 12155 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39566:
table { table_name: "default.Table_35a03681af3042babb0e601163d9fe20" } modify_external_catalogs: true
I20260502 20:00:58.966369 12154 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39566:
table { table_name: "default.Table_41826ad67ed540e0a427cd0347407518" } modify_external_catalogs: true
I20260502 20:00:58.966478 12154 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39566:
table { table_name: "default.Table_41826ad67ed540e0a427cd0347407518" } modify_external_catalogs: true
I20260502 20:00:58.966369 12155 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39566:
table { table_name: "default.Table_35a03681af3042babb0e601163d9fe20" } modify_external_catalogs: true
I20260502 20:00:58.966768 12163 master_service.cc:954] ReplaceTablet: received request to replace tablet b3f6a9613e594f12b0e518d0b9d9e7ed from {username='slave'} at 127.0.0.1:39566
W20260502 20:00:58.968418 12149 consensus_peers.cc:597] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec -> Peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Couldn't send request to peer b470a66ad54f46b1b44a80dd1edf214e. Status: Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260502 20:00:58.971892 12382 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Refusing update from remote peer 38315e4f56484666b5e54afad02498ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 113. Preceding OpId from leader: term: 7 index: 122. (index mismatch)
I20260502 20:00:58.972584 12438 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 121, Last known committed idx: 113, Time since last communication: 0.000s
F20260502 20:00:58.973692 12216 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 26, previous 26; dumping first 3 out of 13 received events: NotificationEvent(eventId=25, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_b19cf190454d42ff99d3fcab96f783b1, message={"server":"","servicePrincipal":"","db":"default","table":"table_b19cf190454d42ff99d3fcab96f783b1","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_b19cf190454d42ff99d3fcab96f783b1\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752048},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b19cf190454d42ff99d3fcab96f783b1\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b19cf190454d42ff99d3fcab96f783b1\",\"kudu.table_id\":\"33b0206efcd84429a0b2bc366a81e1fb\",\"transient_lastDdlTime\":\"1777752048\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=ALTER_TABLE, dbName=default, tableName=table_b9b31b57bb724b299b6000678ee9e5a4, message={"server":"","servicePrincipal":"","db":"default","table":"table_24faf39307584530a038ed30536bd4c2","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_24faf39307584530a038ed30536bd4c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_24faf39307584530a038ed30536bd4c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_24faf39307584530a038ed30536bd4c2\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_b9b31b57bb724b299b6000678ee9e5a4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b9b31b57bb724b299b6000678ee9e5a4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b9b31b57bb724b299b6000678ee9e5a4\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1777752049}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_8ad450efb0df42d2bb35c3f8d3e0b78e, message={"server":"","servicePrincipal":"","db":"default","table":"table_8ad450efb0df42d2bb35c3f8d3e0b78e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752049},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_8ad450efb0df42d2bb35c3f8d3e0b78e\",\"kudu.table_id\":\"7d9fa0bb8a9b4877b6bbbac853119f8d\",\"transient_lastDdlTime\":\"1777752049\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7ff9401d5dcd google::LogMessage::Fail() at ??:0
@ 0x7ff9401d9b93 google::LogMessage::SendToLog() at ??:0
@ 0x7ff9401d57cc google::LogMessage::Flush() at ??:0
I20260502 20:00:58.982546 12412 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38315e4f56484666b5e54afad02498ec. Latest consensus state: current_term: 7 leader_uuid: "38315e4f56484666b5e54afad02498ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:58.982694 12412 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:58.982802 12412 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "38315e4f56484666b5e54afad02498ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:58.982883 12412 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7ff9401d5a11 google::LogMessage::~LogMessage() at ??:0
I20260502 20:00:58.984719 12438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "38315e4f56484666b5e54afad02498ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:58.984858 12438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec [sys.catalog]: This master's current role is: LEADER
I20260502 20:00:58.986555 12161 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet 34eaaaf6417a4e80b3409ea1fdcac25b
I20260502 20:00:58.986868 12160 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet c8e6be4db78c4544bca924bcbff3a4b9
I20260502 20:00:58.987215 12445 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "38315e4f56484666b5e54afad02498ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:00:58.987339 12445 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:00:58.987318 12162 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet 029a4177bfc64776b461dadc4da2c743
I20260502 20:00:58.987526 12157 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a
I20260502 20:00:58.987798 12161 catalog_manager.cc:6741] ReplaceTablet: tablet 34eaaaf6417a4e80b3409ea1fdcac25b deleted and replaced by tablet cd6cf90f390a4d679bc1400d82e529f3
I20260502 20:00:58.987838 12162 catalog_manager.cc:6741] ReplaceTablet: tablet 029a4177bfc64776b461dadc4da2c743 deleted and replaced by tablet faafd4c8dd3a4e2ebea018657480f840
I20260502 20:00:58.987959 12157 catalog_manager.cc:6741] ReplaceTablet: tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a deleted and replaced by tablet 12e5086b6f174f8ca5cacfe9ee8e58ff
I20260502 20:00:58.988162 12157 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39566:
name: "default.Table_e36b131ff7344eba80b753a6b7ff4c11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:58.988209 12162 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39566:
name: "default.Table_b19cf190454d42ff99d3fcab96f783b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:58.988135 12161 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39566:
name: "default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:58.989101 12163 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 38315e4f56484666b5e54afad02498ec: Sending DeleteTablet for 3 replicas of tablet b3f6a9613e594f12b0e518d0b9d9e7ed
I20260502 20:00:58.989354 12163 catalog_manager.cc:6741] ReplaceTablet: tablet b3f6a9613e594f12b0e518d0b9d9e7ed deleted and replaced by tablet 08346b0845c4478d9040446f9ef06dc5
I20260502 20:00:58.989554 12163 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39566:
name: "default.Table_bcbf40331f9a4354927f24a56b69f1f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:58.991636 12160 catalog_manager.cc:6741] ReplaceTablet: tablet c8e6be4db78c4544bca924bcbff3a4b9 deleted and replaced by tablet 517527573a1d40239755d762cb328e79
I20260502 20:00:58.991856 12160 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39566:
name: "default.Table_6b8d71e2af3a4d8ca933ba45c43b464e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:00:58.995178 12443 mvcc.cc:204] Tried to move back new op lower bound from 7281672433538297856 to 7281672419737731072. Current Snapshot: MvccSnapshot[applied={T|T < 7281672433538297856}]
I20260502 20:00:58.996956 11110 tablet_service.cc:1558] Processing DeleteTablet for tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a with delete_type TABLET_DATA_DELETED (replaced by tablet 12e5086b6f174f8ca5cacfe9ee8e58ff) from {username='slave'} at 127.0.0.1:46736
I20260502 20:00:58.997120 11108 tablet_service.cc:1558] Processing DeleteTablet for tablet b3f6a9613e594f12b0e518d0b9d9e7ed with delete_type TABLET_DATA_DELETED (replaced by tablet 08346b0845c4478d9040446f9ef06dc5) from {username='slave'} at 127.0.0.1:46736
I20260502 20:00:58.997162 11111 tablet_service.cc:1558] Processing DeleteTablet for tablet 34eaaaf6417a4e80b3409ea1fdcac25b with delete_type TABLET_DATA_DELETED (replaced by tablet cd6cf90f390a4d679bc1400d82e529f3) from {username='slave'} at 127.0.0.1:46736
I20260502 20:00:58.997311 11109 tablet_service.cc:1558] Processing DeleteTablet for tablet c8e6be4db78c4544bca924bcbff3a4b9 with delete_type TABLET_DATA_DELETED (replaced by tablet 517527573a1d40239755d762cb328e79) from {username='slave'} at 127.0.0.1:46736
I20260502 20:00:58.997335 11107 tablet_service.cc:1558] Processing DeleteTablet for tablet 029a4177bfc64776b461dadc4da2c743 with delete_type TABLET_DATA_DELETED (replaced by tablet faafd4c8dd3a4e2ebea018657480f840) from {username='slave'} at 127.0.0.1:46736
@ 0x7ff945749433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 20:00:58.998667 11107 tablet_service.cc:1511] Processing CreateTablet for tablet 12e5086b6f174f8ca5cacfe9ee8e58ff (DEFAULT_TABLE table=default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:58.999049 11107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12e5086b6f174f8ca5cacfe9ee8e58ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.000097 10973 tablet_service.cc:1558] Processing DeleteTablet for tablet b3f6a9613e594f12b0e518d0b9d9e7ed with delete_type TABLET_DATA_DELETED (replaced by tablet 08346b0845c4478d9040446f9ef06dc5) from {username='slave'} at 127.0.0.1:44470
I20260502 20:00:59.000195 10974 tablet_service.cc:1558] Processing DeleteTablet for tablet 34eaaaf6417a4e80b3409ea1fdcac25b with delete_type TABLET_DATA_DELETED (replaced by tablet cd6cf90f390a4d679bc1400d82e529f3) from {username='slave'} at 127.0.0.1:44470
I20260502 20:00:59.000308 10976 tablet_service.cc:1558] Processing DeleteTablet for tablet 029a4177bfc64776b461dadc4da2c743 with delete_type TABLET_DATA_DELETED (replaced by tablet faafd4c8dd3a4e2ebea018657480f840) from {username='slave'} at 127.0.0.1:44470
I20260502 20:00:59.000344 10975 tablet_service.cc:1558] Processing DeleteTablet for tablet c8e6be4db78c4544bca924bcbff3a4b9 with delete_type TABLET_DATA_DELETED (replaced by tablet 517527573a1d40239755d762cb328e79) from {username='slave'} at 127.0.0.1:44470
I20260502 20:00:59.000402 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a with delete_type TABLET_DATA_DELETED (replaced by tablet 12e5086b6f174f8ca5cacfe9ee8e58ff) from {username='slave'} at 127.0.0.1:44470
I20260502 20:00:59.000473 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 12e5086b6f174f8ca5cacfe9ee8e58ff (DEFAULT_TABLE table=default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.000772 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12e5086b6f174f8ca5cacfe9ee8e58ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.002398 11109 tablet_service.cc:1511] Processing CreateTablet for tablet 517527573a1d40239755d762cb328e79 (DEFAULT_TABLE table=default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.002645 11109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 517527573a1d40239755d762cb328e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.002871 10975 tablet_service.cc:1511] Processing CreateTablet for tablet cd6cf90f390a4d679bc1400d82e529f3 (DEFAULT_TABLE table=default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.003050 10976 tablet_service.cc:1511] Processing CreateTablet for tablet faafd4c8dd3a4e2ebea018657480f840 (DEFAULT_TABLE table=default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.003149 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd6cf90f390a4d679bc1400d82e529f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.003237 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faafd4c8dd3a4e2ebea018657480f840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.002879 10977 tablet_service.cc:1511] Processing CreateTablet for tablet 517527573a1d40239755d762cb328e79 (DEFAULT_TABLE table=default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.005450 10977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 517527573a1d40239755d762cb328e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.006049 12460 tablet_replica.cc:333] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:59.006214 12460 raft_consensus.cc:2243] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:59.006359 12460 raft_consensus.cc:2272] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.006839 12460 ts_tablet_manager.cc:1916] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.010593 11107 tablet_service.cc:1511] Processing CreateTablet for tablet cd6cf90f390a4d679bc1400d82e529f3 (DEFAULT_TABLE table=default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.010855 11107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd6cf90f390a4d679bc1400d82e529f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.011111 11109 tablet_service.cc:1511] Processing CreateTablet for tablet faafd4c8dd3a4e2ebea018657480f840 (DEFAULT_TABLE table=default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.011437 11109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faafd4c8dd3a4e2ebea018657480f840. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7ff94574834a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 20:00:59.015750 11246 tablet_service.cc:1558] Processing DeleteTablet for tablet 34eaaaf6417a4e80b3409ea1fdcac25b with delete_type TABLET_DATA_DELETED (replaced by tablet cd6cf90f390a4d679bc1400d82e529f3) from {username='slave'} at 127.0.0.1:51018
I20260502 20:00:59.016307 11246 tablet_service.cc:1511] Processing CreateTablet for tablet 517527573a1d40239755d762cb328e79 (DEFAULT_TABLE table=default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.016453 11251 tablet_service.cc:1558] Processing DeleteTablet for tablet c8e6be4db78c4544bca924bcbff3a4b9 with delete_type TABLET_DATA_DELETED (replaced by tablet 517527573a1d40239755d762cb328e79) from {username='slave'} at 127.0.0.1:51018
I20260502 20:00:59.016585 11248 tablet_service.cc:1558] Processing DeleteTablet for tablet b3f6a9613e594f12b0e518d0b9d9e7ed with delete_type TABLET_DATA_DELETED (replaced by tablet 08346b0845c4478d9040446f9ef06dc5) from {username='slave'} at 127.0.0.1:51018
I20260502 20:00:59.016649 11246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 517527573a1d40239755d762cb328e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.016705 11253 tablet_service.cc:1511] Processing CreateTablet for tablet 12e5086b6f174f8ca5cacfe9ee8e58ff (DEFAULT_TABLE table=default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.016911 11253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12e5086b6f174f8ca5cacfe9ee8e58ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.017095 10977 tablet_service.cc:1511] Processing CreateTablet for tablet 08346b0845c4478d9040446f9ef06dc5 (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.017367 10977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08346b0845c4478d9040446f9ef06dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.018479 12460 ts_tablet_manager.cc:1929] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:59.018553 12460 log.cc:1199] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/c3ee63c93d1c47b7b1d61c5a2c7fae1a
I20260502 20:00:59.018877 12460 ts_tablet_manager.cc:1950] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:59.016315 11247 tablet_service.cc:1558] Processing DeleteTablet for tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a with delete_type TABLET_DATA_DELETED (replaced by tablet 12e5086b6f174f8ca5cacfe9ee8e58ff) from {username='slave'} at 127.0.0.1:51018
I20260502 20:00:59.016350 11252 tablet_service.cc:1558] Processing DeleteTablet for tablet 029a4177bfc64776b461dadc4da2c743 with delete_type TABLET_DATA_DELETED (replaced by tablet faafd4c8dd3a4e2ebea018657480f840) from {username='slave'} at 127.0.0.1:51018
I20260502 20:00:59.019170 11250 tablet_service.cc:1511] Processing CreateTablet for tablet cd6cf90f390a4d679bc1400d82e529f3 (DEFAULT_TABLE table=default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.019382 11250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd6cf90f390a4d679bc1400d82e529f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.019745 12468 tablet_bootstrap.cc:492] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
@ 0x7ff945747aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 20:00:59.020107 12150 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet c3ee63c93d1c47b7b1d61c5a2c7fae1a (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]) successfully deleted
I20260502 20:00:59.020412 12460 tablet_replica.cc:333] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:59.020653 12462 tablet_bootstrap.cc:492] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:59.021370 11249 tablet_service.cc:1511] Processing CreateTablet for tablet faafd4c8dd3a4e2ebea018657480f840 (DEFAULT_TABLE table=default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.021435 12468 tablet_bootstrap.cc:654] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.021590 11249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faafd4c8dd3a4e2ebea018657480f840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.022055 12460 raft_consensus.cc:2243] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:59.022269 12462 tablet_bootstrap.cc:654] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.022284 12460 raft_consensus.cc:2272] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.022707 12460 ts_tablet_manager.cc:1916] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7ff94574d1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x56085c0a3244 std::function<>::operator()() at ??:0
I20260502 20:00:59.024703 11109 tablet_service.cc:1511] Processing CreateTablet for tablet 08346b0845c4478d9040446f9ef06dc5 (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.024791 11249 tablet_service.cc:1511] Processing CreateTablet for tablet 08346b0845c4478d9040446f9ef06dc5 (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:00:59.024998 11109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08346b0845c4478d9040446f9ef06dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.025007 11249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08346b0845c4478d9040446f9ef06dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:00:59.025338 12468 tablet_bootstrap.cc:492] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:59.025414 12468 ts_tablet_manager.cc:1403] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260502 20:00:59.025944 12468 raft_consensus.cc:359] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:59.026050 12468 raft_consensus.cc:385] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.026083 12468 raft_consensus.cc:740] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.026245 12468 consensus_queue.cc:260] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:59.024758 12460 ts_tablet_manager.cc:1929] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:59.027757 12460 log.cc:1199] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/b3f6a9613e594f12b0e518d0b9d9e7ed
I20260502 20:00:59.027779 12468 ts_tablet_manager.cc:1434] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 20:00:59.027943 12468 tablet_bootstrap.cc:492] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
@ 0x7ff9416da7ea kudu::Thread::SuperviseThread() at ??:0
I20260502 20:00:59.028242 12460 ts_tablet_manager.cc:1950] T b3f6a9613e594f12b0e518d0b9d9e7ed P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:59.029029 12150 catalog_manager.cc:5002] TS b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): tablet b3f6a9613e594f12b0e518d0b9d9e7ed (table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]) successfully deleted
I20260502 20:00:59.029188 12468 tablet_bootstrap.cc:654] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.029289 12460 tablet_replica.cc:333] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:59.029449 12460 raft_consensus.cc:2243] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:59.029577 12460 raft_consensus.cc:2272] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.030359 12468 tablet_bootstrap.cc:492] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:59.030429 12468 ts_tablet_manager.cc:1403] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
@ 0x7ff94201e6db start_thread at ??:0
I20260502 20:00:59.030915 12468 raft_consensus.cc:359] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.031037 12468 raft_consensus.cc:385] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.031029 12460 ts_tablet_manager.cc:1916] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.031067 12466 tablet_replica.cc:333] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:59.031072 12468 raft_consensus.cc:740] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.031213 12466 raft_consensus.cc:2243] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:59.031250 12468 consensus_queue.cc:260] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.031327 12466 raft_consensus.cc:2272] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.031749 12466 ts_tablet_manager.cc:1916] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.032238 12468 ts_tablet_manager.cc:1434] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260502 20:00:59.032408 12468 tablet_bootstrap.cc:492] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:59.033363 12468 tablet_bootstrap.cc:654] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
@ 0x7ff93f38c61f clone at ??:0
I20260502 20:00:59.033521 12460 ts_tablet_manager.cc:1929] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:59.033586 12460 log.cc:1199] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/34eaaaf6417a4e80b3409ea1fdcac25b
I20260502 20:00:59.024101 12465 tablet_bootstrap.cc:492] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:59.034631 12461 tablet_replica.cc:333] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:59.034760 12461 raft_consensus.cc:2243] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:59.034863 12461 raft_consensus.cc:2272] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.035059 12466 ts_tablet_manager.cc:1929] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:59.035122 12466 log.cc:1199] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/34eaaaf6417a4e80b3409ea1fdcac25b
I20260502 20:00:59.035252 12461 ts_tablet_manager.cc:1916] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.035388 12466 ts_tablet_manager.cc:1950] T 34eaaaf6417a4e80b3409ea1fdcac25b P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:59.036019 12466 tablet_replica.cc:333] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:59.036129 12466 raft_consensus.cc:2243] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:59.036202 12466 raft_consensus.cc:2272] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.036504 12466 ts_tablet_manager.cc:1916] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.037503 12465 tablet_bootstrap.cc:654] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.037572 11180 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:00:59.038360 12466 ts_tablet_manager.cc:1929] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:59.038424 12466 log.cc:1199] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/c8e6be4db78c4544bca924bcbff3a4b9
I20260502 20:00:59.038684 12466 ts_tablet_manager.cc:1950] T c8e6be4db78c4544bca924bcbff3a4b9 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:59.038681 12460 ts_tablet_manager.cc:1950] T 34eaaaf6417a4e80b3409ea1fdcac25b P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:59.039165 12371 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" instance_seqno: 1777752043728997) as {username='slave'} at 127.10.27.130:39191; Asking this server to re-register.
I20260502 20:00:59.039326 12468 tablet_bootstrap.cc:492] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:59.039400 12460 tablet_replica.cc:333] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:59.039415 12468 ts_tablet_manager.cc:1403] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260502 20:00:59.039520 12460 raft_consensus.cc:2243] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:59.039623 12460 raft_consensus.cc:2272] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.039876 11180 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:59.039881 12468 raft_consensus.cc:359] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.039948 12460 ts_tablet_manager.cc:1916] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.039991 12468 raft_consensus.cc:385] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.040024 12468 raft_consensus.cc:740] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.040149 12468 consensus_queue.cc:260] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.040397 12468 ts_tablet_manager.cc:1434] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:00:59.040570 12468 tablet_bootstrap.cc:492] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:59.041325 12371 ts_manager.cc:194] Registered new tserver with Master: b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:59.041579 12468 tablet_bootstrap.cc:654] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.041981 12460 ts_tablet_manager.cc:1929] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:59.042040 12460 log.cc:1199] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/c8e6be4db78c4544bca924bcbff3a4b9
I20260502 20:00:59.039312 12466 tablet_replica.cc:333] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:59.042304 12460 ts_tablet_manager.cc:1950] T c8e6be4db78c4544bca924bcbff3a4b9 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:59.042368 12466 raft_consensus.cc:2243] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:59.042483 12466 raft_consensus.cc:2272] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.042876 12466 ts_tablet_manager.cc:1916] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.043717 12465 tablet_bootstrap.cc:492] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:59.043803 12465 ts_tablet_manager.cc:1403] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20260502 20:00:59.044323 12465 raft_consensus.cc:359] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:59.044420 12465 raft_consensus.cc:385] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.044449 12465 raft_consensus.cc:740] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.044571 12465 consensus_queue.cc:260] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:59.044885 12465 ts_tablet_manager.cc:1434] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:00:59.044883 12466 ts_tablet_manager.cc:1929] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:59.044951 12466 log.cc:1199] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/b3f6a9613e594f12b0e518d0b9d9e7ed
I20260502 20:00:59.045192 12466 ts_tablet_manager.cc:1950] T b3f6a9613e594f12b0e518d0b9d9e7ed P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:59.038681 12462 tablet_bootstrap.cc:492] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:59.045439 12462 ts_tablet_manager.cc:1403] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260502 20:00:59.045969 12462 raft_consensus.cc:359] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:59.046073 12462 raft_consensus.cc:385] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.046109 12462 raft_consensus.cc:740] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.046142 12465 tablet_bootstrap.cc:492] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:59.046662 12466 tablet_replica.cc:333] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:59.046763 12466 raft_consensus.cc:2243] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:59.046988 12466 raft_consensus.cc:2272] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.047345 12466 ts_tablet_manager.cc:1916] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.047623 12465 tablet_bootstrap.cc:654] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.048914 12465 tablet_bootstrap.cc:492] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:59.048986 12465 ts_tablet_manager.cc:1403] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:59.049535 12466 ts_tablet_manager.cc:1929] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:59.049602 12466 log.cc:1199] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/c3ee63c93d1c47b7b1d61c5a2c7fae1a
I20260502 20:00:59.049634 12465 raft_consensus.cc:359] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.049770 12465 raft_consensus.cc:385] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.049811 12465 raft_consensus.cc:740] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.049873 12466 ts_tablet_manager.cc:1950] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:59.049963 12465 consensus_queue.cc:260] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.050359 12465 ts_tablet_manager.cc:1434] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:59.050593 12465 tablet_bootstrap.cc:492] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:59.051303 11045 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:00:59.051389 12466 tablet_replica.cc:333] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:00:59.051512 12466 raft_consensus.cc:2243] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:59.051632 12466 raft_consensus.cc:2272] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.051754 12306 raft_consensus.cc:493] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:59.051820 12306 raft_consensus.cc:515] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:59.052181 12465 tablet_bootstrap.cc:654] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.052229 12306 leader_election.cc:290] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:59.052455 12462 consensus_queue.cc:260] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:59.052721 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e5086b6f174f8ca5cacfe9ee8e58ff" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:59.052824 12462 ts_tablet_manager.cc:1434] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260502 20:00:59.052839 11131 raft_consensus.cc:2468] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:59.053031 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e5086b6f174f8ca5cacfe9ee8e58ff" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:59.053141 10982 raft_consensus.cc:2468] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:59.053731 12461 ts_tablet_manager.cc:1929] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:59.053802 12461 log.cc:1199] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/b3f6a9613e594f12b0e518d0b9d9e7ed
I20260502 20:00:59.053922 11209 leader_election.cc:304] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:59.054114 12461 ts_tablet_manager.cc:1950] T b3f6a9613e594f12b0e518d0b9d9e7ed P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:59.054121 12306 raft_consensus.cc:2804] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:59.054167 12306 raft_consensus.cc:493] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:59.054211 12306 raft_consensus.cc:3060] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.054309 12466 ts_tablet_manager.cc:1916] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.054450 12465 tablet_bootstrap.cc:492] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:59.054530 12465 ts_tablet_manager.cc:1403] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 20:00:59.055050 12465 raft_consensus.cc:359] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.055142 12465 raft_consensus.cc:385] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.055172 12465 raft_consensus.cc:740] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.055297 12465 consensus_queue.cc:260] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.055591 12465 ts_tablet_manager.cc:1434] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:59.055567 12306 raft_consensus.cc:515] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:59.055765 12465 tablet_bootstrap.cc:492] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:59.055917 12306 leader_election.cc:290] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:59.056478 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e5086b6f174f8ca5cacfe9ee8e58ff" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:59.056596 11131 raft_consensus.cc:3060] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.056632 12466 ts_tablet_manager.cc:1929] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:59.056695 12466 log.cc:1199] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/029a4177bfc64776b461dadc4da2c743
I20260502 20:00:59.056847 12465 tablet_bootstrap.cc:654] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.056931 12466 ts_tablet_manager.cc:1950] T 029a4177bfc64776b461dadc4da2c743 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:00:59.057225 12372 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" instance_seqno: 1777752043533877) as {username='slave'} at 127.10.27.129:33229; Asking this server to re-register.
I20260502 20:00:59.057659 11131 raft_consensus.cc:2468] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:59.057862 12462 tablet_bootstrap.cc:492] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:59.058060 11209 leader_election.cc:304] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:59.058048 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12e5086b6f174f8ca5cacfe9ee8e58ff" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:59.058149 10982 raft_consensus.cc:3060] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.058372 11045 heartbeater.cc:461] Registering TS with master...
I20260502 20:00:59.058400 12461 tablet_replica.cc:333] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:59.058528 12461 raft_consensus.cc:2243] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:59.058708 12461 raft_consensus.cc:2272] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.059031 12462 tablet_bootstrap.cc:654] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.059085 10982 raft_consensus.cc:2468] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:59.059110 12461 ts_tablet_manager.cc:1916] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.059860 12372 ts_manager.cc:194] Registered new tserver with Master: 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:00:59.061414 12460 tablet_replica.cc:333] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:00:59.061568 12460 raft_consensus.cc:2243] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:59.061583 12461 ts_tablet_manager.cc:1929] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:00:59.061645 12461 log.cc:1199] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/34eaaaf6417a4e80b3409ea1fdcac25b
I20260502 20:00:59.061687 12460 raft_consensus.cc:2272] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.061900 12461 ts_tablet_manager.cc:1950] T 34eaaaf6417a4e80b3409ea1fdcac25b P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:59.062119 12460 ts_tablet_manager.cc:1916] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.062347 12306 raft_consensus.cc:2804] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:59.062590 12306 raft_consensus.cc:697] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Becoming Leader. State: Replica: ade741c4062940adb2223b55187ffe72, State: Running, Role: LEADER
I20260502 20:00:59.062739 12306 consensus_queue.cc:237] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:00:59.064608 12460 ts_tablet_manager.cc:1929] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:59.064687 12460 log.cc:1199] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/029a4177bfc64776b461dadc4da2c743
I20260502 20:00:59.064939 12460 ts_tablet_manager.cc:1950] T 029a4177bfc64776b461dadc4da2c743 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:00:59.065528 12461 tablet_replica.cc:333] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:59.065658 12461 raft_consensus.cc:2243] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:59.065855 12461 raft_consensus.cc:2272] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.066250 12461 ts_tablet_manager.cc:1916] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.067652 12468 tablet_bootstrap.cc:492] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:59.067745 12468 ts_tablet_manager.cc:1403] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.002s
I20260502 20:00:59.067838 12465 tablet_bootstrap.cc:492] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:59.067922 12465 ts_tablet_manager.cc:1403] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260502 20:00:59.068182 12462 tablet_bootstrap.cc:492] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:59.068262 12462 ts_tablet_manager.cc:1403] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260502 20:00:59.068305 12468 raft_consensus.cc:359] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.068413 12468 raft_consensus.cc:385] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.068444 12468 raft_consensus.cc:740] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.068400 12465 raft_consensus.cc:359] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.068502 12465 raft_consensus.cc:385] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.068534 12465 raft_consensus.cc:740] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.068563 12468 consensus_queue.cc:260] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.068651 12465 consensus_queue.cc:260] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.068760 12462 raft_consensus.cc:359] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.068852 12468 ts_tablet_manager.cc:1434] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:00:59.068859 12462 raft_consensus.cc:385] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.068892 12462 raft_consensus.cc:740] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.068964 12465 ts_tablet_manager.cc:1434] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260502 20:00:59.069043 12468 tablet_bootstrap.cc:492] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:00:59.069022 12462 consensus_queue.cc:260] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.069519 12462 ts_tablet_manager.cc:1434] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:59.070158 12462 tablet_bootstrap.cc:492] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:59.070693 12468 tablet_bootstrap.cc:654] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.072194 12468 tablet_bootstrap.cc:492] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:00:59.072288 12468 ts_tablet_manager.cc:1403] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:59.071429 12462 tablet_bootstrap.cc:654] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.072886 12468 raft_consensus.cc:359] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.073042 12468 raft_consensus.cc:385] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.073091 12468 raft_consensus.cc:740] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.073424 12468 consensus_queue.cc:260] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.073870 12468 ts_tablet_manager.cc:1434] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260502 20:00:59.077803 12462 tablet_bootstrap.cc:492] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:59.077939 12462 ts_tablet_manager.cc:1403] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260502 20:00:59.078081 12461 ts_tablet_manager.cc:1929] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:59.078161 12461 log.cc:1199] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/029a4177bfc64776b461dadc4da2c743
I20260502 20:00:59.078379 12465 tablet_bootstrap.cc:492] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:00:59.078436 12461 ts_tablet_manager.cc:1950] T 029a4177bfc64776b461dadc4da2c743 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:59.078617 12462 raft_consensus.cc:359] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.078785 12462 raft_consensus.cc:385] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.078830 12462 raft_consensus.cc:740] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.079023 12462 consensus_queue.cc:260] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.079406 12462 ts_tablet_manager.cc:1434] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260502 20:00:59.079618 12462 tablet_bootstrap.cc:492] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:59.079810 12461 tablet_replica.cc:333] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:59.079954 12461 raft_consensus.cc:2243] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:00:59.080171 12461 raft_consensus.cc:2272] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.080734 12461 ts_tablet_manager.cc:1916] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.080879 12462 tablet_bootstrap.cc:654] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.083398 12462 tablet_bootstrap.cc:492] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:59.083489 12462 ts_tablet_manager.cc:1403] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260502 20:00:59.084003 12462 raft_consensus.cc:359] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.084131 12462 raft_consensus.cc:385] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.084167 12462 raft_consensus.cc:740] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.084342 12462 consensus_queue.cc:260] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.085589 12462 ts_tablet_manager.cc:1434] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260502 20:00:59.086724 12462 tablet_bootstrap.cc:492] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:00:59.087167 12461 ts_tablet_manager.cc:1929] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:59.087248 12461 log.cc:1199] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/c8e6be4db78c4544bca924bcbff3a4b9
I20260502 20:00:59.087541 12461 ts_tablet_manager.cc:1950] T c8e6be4db78c4544bca924bcbff3a4b9 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:59.088136 12462 tablet_bootstrap.cc:654] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.088279 12461 tablet_replica.cc:333] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:00:59.088416 12461 raft_consensus.cc:2243] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:00:59.088551 12461 raft_consensus.cc:2272] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:00:59.088986 12461 ts_tablet_manager.cc:1916] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:00:59.089903 12462 tablet_bootstrap.cc:492] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:00:59.079705 12465 tablet_bootstrap.cc:654] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:00:59.092105 12461 ts_tablet_manager.cc:1929] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:00:59.089983 12462 ts_tablet_manager.cc:1403] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 20:00:59.094488 12461 log.cc:1199] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/c3ee63c93d1c47b7b1d61c5a2c7fae1a
I20260502 20:00:59.094779 12461 ts_tablet_manager.cc:1950] T c3ee63c93d1c47b7b1d61c5a2c7fae1a P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:00:59.095094 12462 raft_consensus.cc:359] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.095224 12462 raft_consensus.cc:385] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.095258 12462 raft_consensus.cc:740] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.095386 12462 consensus_queue.cc:260] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.095569 12465 tablet_bootstrap.cc:492] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:00:59.095649 12462 ts_tablet_manager.cc:1434] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:00:59.095656 12465 ts_tablet_manager.cc:1403] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.002s
I20260502 20:00:59.096383 12465 raft_consensus.cc:359] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.096516 12465 raft_consensus.cc:385] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:00:59.096555 12465 raft_consensus.cc:740] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:00:59.105316 12465 consensus_queue.cc:260] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.105744 12465 ts_tablet_manager.cc:1434] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260502 20:00:59.145289 12334 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:59.145424 12334 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.146184 12334 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:59.146401 12480 raft_consensus.cc:493] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:59.146517 12480 raft_consensus.cc:515] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.146713 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faafd4c8dd3a4e2ebea018657480f840" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:59.146751 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faafd4c8dd3a4e2ebea018657480f840" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:59.146863 10982 raft_consensus.cc:2468] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:59.147047 11273 raft_consensus.cc:2468] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:00:59.147073 12480 leader_election.cc:290] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:59.147238 11065 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:59.147513 12334 raft_consensus.cc:2804] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:59.147578 12334 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:59.147645 12334 raft_consensus.cc:3060] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.147686 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6cf90f390a4d679bc1400d82e529f3" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:59.147742 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6cf90f390a4d679bc1400d82e529f3" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:00:59.147786 11131 raft_consensus.cc:2468] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:59.147857 10982 raft_consensus.cc:2468] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:00:59.148106 11209 leader_election.cc:304] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:59.148342 12480 raft_consensus.cc:2804] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:59.148398 12480 raft_consensus.cc:493] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:59.148437 12480 raft_consensus.cc:3060] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.148865 12334 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.149258 12334 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:59.149488 12480 raft_consensus.cc:515] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.149641 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faafd4c8dd3a4e2ebea018657480f840" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:59.149667 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faafd4c8dd3a4e2ebea018657480f840" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:59.149755 10982 raft_consensus.cc:3060] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.149770 11273 raft_consensus.cc:3060] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.149859 12480 leader_election.cc:290] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:00:59.150516 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6cf90f390a4d679bc1400d82e529f3" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:59.150641 11131 raft_consensus.cc:3060] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.150744 11273 raft_consensus.cc:2468] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:59.150761 10982 raft_consensus.cc:2468] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:00:59.151125 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd6cf90f390a4d679bc1400d82e529f3" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:00:59.151216 10982 raft_consensus.cc:3060] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.151377 11065 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:59.151648 11131 raft_consensus.cc:2468] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:59.151748 12334 raft_consensus.cc:2804] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:59.151975 12334 raft_consensus.cc:697] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:00:59.152117 10982 raft_consensus.cc:2468] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:00:59.152407 11206 leader_election.cc:304] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:59.152673 12480 raft_consensus.cc:2804] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:59.152781 12480 raft_consensus.cc:697] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Becoming Leader. State: Replica: ade741c4062940adb2223b55187ffe72, State: Running, Role: LEADER
I20260502 20:00:59.152941 12480 consensus_queue.cc:237] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.152859 12334 consensus_queue.cc:237] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
W20260502 20:00:59.232254 11206 connection.cc:570] server connection from 127.0.0.1:51018 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:59.232313 11066 connection.cc:570] server connection from 127.0.0.1:46736 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:59.232353 10931 connection.cc:570] client connection to 127.10.27.190:46101 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:59.232474 10930 connection.cc:570] server connection from 127.0.0.1:44470 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:59.233366 11327 connection.cc:570] client connection to 127.10.27.190:46101 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:00:59.233947 11327 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.10.27.190:46101)
W20260502 20:00:59.234282 11327 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.27.190:46101)
W20260502 20:00:59.234476 11327 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.10.27.190:46101)
W20260502 20:00:59.234623 11327 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.10.27.190:46101)
I20260502 20:00:59.287693 12067 raft_consensus.cc:493] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:59.287817 12067 raft_consensus.cc:515] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.288282 12067 leader_election.cc:290] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:59.288717 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08346b0845c4478d9040446f9ef06dc5" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:59.288749 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08346b0845c4478d9040446f9ef06dc5" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:59.288847 11273 raft_consensus.cc:2468] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:59.288901 11131 raft_consensus.cc:2468] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:59.289251 10933 leader_election.cc:304] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:59.289422 12067 raft_consensus.cc:2804] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:59.289485 12067 raft_consensus.cc:493] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:59.289526 12067 raft_consensus.cc:3060] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.290457 12067 raft_consensus.cc:515] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.290838 12067 leader_election.cc:290] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:59.291128 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08346b0845c4478d9040446f9ef06dc5" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:59.291254 11131 raft_consensus.cc:3060] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.291311 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08346b0845c4478d9040446f9ef06dc5" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:59.291414 11273 raft_consensus.cc:3060] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.292223 11131 raft_consensus.cc:2468] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:59.292520 10933 leader_election.cc:304] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:00:59.292637 11273 raft_consensus.cc:2468] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:59.292712 12067 raft_consensus.cc:2804] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:59.292886 12067 raft_consensus.cc:697] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:59.293049 12067 consensus_queue.cc:237] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.379513 12067 raft_consensus.cc:493] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:00:59.379669 12067 raft_consensus.cc:515] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.380091 12067 leader_election.cc:290] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:59.380642 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517527573a1d40239755d762cb328e79" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:00:59.380642 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517527573a1d40239755d762cb328e79" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:00:59.380810 11273 raft_consensus.cc:2468] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:59.380810 11131 raft_consensus.cc:2468] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:00:59.381284 10930 leader_election.cc:304] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:59.381548 12067 raft_consensus.cc:2804] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:00:59.381639 12067 raft_consensus.cc:493] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:00:59.381696 12067 raft_consensus.cc:3060] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.382588 12067 raft_consensus.cc:515] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.383152 12067 leader_election.cc:290] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:00:59.383641 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517527573a1d40239755d762cb328e79" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:00:59.383647 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "517527573a1d40239755d762cb328e79" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:00:59.383805 11273 raft_consensus.cc:3060] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.383841 11131 raft_consensus.cc:3060] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:00:59.384647 11273 raft_consensus.cc:2468] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:59.384735 11131 raft_consensus.cc:2468] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:00:59.385039 10930 leader_election.cc:304] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:00:59.385257 12067 raft_consensus.cc:2804] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:00:59.385363 12067 raft_consensus.cc:697] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:00:59.385507 12067 consensus_queue.cc:237] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:00:59.516481 12500 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 38315e4f56484666b5e54afad02498ec)
I20260502 20:00:59.516721 12500 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:00:59.518039 12500 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:00:59.518666 12358 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
W20260502 20:00:59.519708 12357 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:00:59.519843 12358 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
I20260502 20:00:59.519932 12358 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e
I20260502 20:00:59.520181 12500 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260502 20:00:59.535245 12480 consensus_queue.cc:1048] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:59.541570 12480 consensus_queue.cc:1048] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:59.687814 12493 consensus_queue.cc:1048] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:59.692480 12334 consensus_queue.cc:1048] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:59.698388 12480 consensus_queue.cc:1048] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:59.701924 12480 consensus_queue.cc:1048] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:59.770824 12067 consensus_queue.cc:1048] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:59.775840 12497 consensus_queue.cc:1048] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:59.916383 12497 consensus_queue.cc:1048] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:00:59.921159 12497 consensus_queue.cc:1048] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:01:00.223330 12522 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 38315e4f56484666b5e54afad02498ec)
I20260502 20:01:00.223500 12522 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:00.224176 12522 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:01:00.225759 12358 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
W20260502 20:01:00.225871 12357 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:00.225929 12357 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e
I20260502 20:01:00.226142 12522 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260502 20:01:00.898128 10350 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu with pid 12337
I20260502 20:01:01.493927 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.189:46281
--webserver_interface=127.10.27.189
--webserver_port=43275
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 20:01:01.612548 12540 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:01:01.612788 12540 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:01:01.612870 12540 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:01:01.616396 12540 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 20:01:01.616487 12540 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:01:01.616520 12540 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 20:01:01.616554 12540 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 20:01:01.620939 12540 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.189:46281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.27.189
--webserver_port=43275
--never_fsync=true
--heap_profile_path=/tmp/kudu.12540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:01:01.622087 12540 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:01:01.623452 12540 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:01:01.629829 12547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:01:01.629827 12546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:01:01.629902 12540 server_base.cc:1061] running on GCE node
W20260502 20:01:01.629827 12549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:01:01.630616 12540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:01:01.631708 12540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:01:01.632879 12540 hybrid_clock.cc:648] HybridClock initialized: now 1777752061632852 us; error 40 us; skew 500 ppm
I20260502 20:01:01.634903 12540 webserver.cc:492] Webserver started at http://127.10.27.189:43275/ using document root <none> and password file <none>
I20260502 20:01:01.635586 12540 fs_manager.cc:362] Metadata directory not provided
I20260502 20:01:01.635646 12540 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:01:01.639335 12540 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260502 20:01:01.641737 12555 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:01:01.643158 12540 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260502 20:01:01.643296 12540 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
uuid: "ef9294b460014382a2a594c77f8900d4"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:01:01.643710 12540 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:01:01.664083 12540 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:01:01.664820 12540 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:01:01.665019 12540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:01:01.673310 12607 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.189:46281 every 8 connection(s)
I20260502 20:01:01.673311 12540 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.189:46281
I20260502 20:01:01.674450 12540 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
I20260502 20:01:01.678536 12608 sys_catalog.cc:263] Verifying existing consensus state
I20260502 20:01:01.680227 12608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Bootstrap starting.
I20260502 20:01:01.682520 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 12540
I20260502 20:01:01.696604 12608 log.cc:826] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Log is configured to *not* fsync() on all Append() calls
I20260502 20:01:01.759174 12608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Bootstrap replayed 1/1 log segments. Stats: ops{read=128 overwritten=0 applied=128 ignored=0} inserts{seen=76 ignored=0} mutations{seen=115 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:01:01.759578 12608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Bootstrap complete.
I20260502 20:01:01.762724 12608 raft_consensus.cc:359] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:01.763310 12608 raft_consensus.cc:740] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9294b460014382a2a594c77f8900d4, State: Initialized, Role: FOLLOWER
I20260502 20:01:01.763743 12608 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 128, Last appended: 7.128, Last appended by leader: 128, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:01.764221 12613 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:01.764374 12613 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:01:01.764923 12608 sys_catalog.cc:565] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260502 20:01:01.770740 12540 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:01:01.773054 12540 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:01:01.773049 12627 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:01:01.773283 12627 catalog_manager.cc:1562] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: loading cluster ID for follower catalog manager: success
I20260502 20:01:01.775888 12627 catalog_manager.cc:1584] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: acquiring CA information for follower catalog manager: success
I20260502 20:01:01.777415 12627 catalog_manager.cc:1612] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 20:01:01.808847 11321 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:01:01.811401 12572 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ade741c4062940adb2223b55187ffe72" instance_seqno: 1777752043938024) as {username='slave'} at 127.10.27.131:55735; Asking this server to re-register.
I20260502 20:01:01.812067 11321 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:01.814051 12572 ts_manager.cc:194] Registered new tserver with Master: ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:01:01.989801 11045 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:01:01.990835 12572 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" instance_seqno: 1777752043533877) as {username='slave'} at 127.10.27.129:40349; Asking this server to re-register.
I20260502 20:01:01.991338 11045 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:01.992259 12572 ts_manager.cc:194] Registered new tserver with Master: 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:01:02.088510 11180 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:01:02.089573 12572 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" instance_seqno: 1777752043728997) as {username='slave'} at 127.10.27.130:51305; Asking this server to re-register.
I20260502 20:01:02.090018 11180 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:02.091130 12572 ts_manager.cc:194] Registered new tserver with Master: b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:02.365437 12636 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:02.365700 12636 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:02.367393 12636 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:01:02.368069 12557 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:02.369279 12557 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:02.369422 12558 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
I20260502 20:01:02.369496 12558 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e
I20260502 20:01:02.369694 12636 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260502 20:01:03.082616 12647 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:03.082746 12647 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:03.083321 12647 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:01:03.084681 12557 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:03.084810 12558 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
I20260502 20:01:03.084923 12558 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e
I20260502 20:01:03.085139 12647 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260502 20:01:04.022612 12663 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:04.022764 12663 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:04.023324 12663 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:01:04.024775 12558 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
W20260502 20:01:04.025121 12557 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:04.025249 12557 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e
I20260502 20:01:04.025444 12663 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260502 20:01:04.729822 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.188:33369
--webserver_interface=127.10.27.188
--webserver_port=35669
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 20:01:04.847208 12674 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:01:04.847463 12674 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:01:04.847512 12674 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:01:04.851823 12674 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 20:01:04.851904 12674 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:01:04.851927 12674 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 20:01:04.852005 12674 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 20:01:04.856992 12674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.188:33369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.27.188
--webserver_port=35669
--never_fsync=true
--heap_profile_path=/tmp/kudu.12674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:01:04.858180 12674 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:01:04.859347 12674 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:01:04.866112 12683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:01:04.866125 12686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:01:04.866112 12684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:01:04.866972 12674 server_base.cc:1061] running on GCE node
I20260502 20:01:04.868026 12674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:01:04.869361 12674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:01:04.870594 12674 hybrid_clock.cc:648] HybridClock initialized: now 1777752064870573 us; error 50 us; skew 500 ppm
I20260502 20:01:04.872848 12674 webserver.cc:492] Webserver started at http://127.10.27.188:35669/ using document root <none> and password file <none>
I20260502 20:01:04.873502 12674 fs_manager.cc:362] Metadata directory not provided
I20260502 20:01:04.873564 12674 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:01:04.877521 12674 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260502 20:01:04.879830 12692 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:01:04.881119 12674 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260502 20:01:04.881273 12674 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
uuid: "b470a66ad54f46b1b44a80dd1edf214e"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:01:04.881688 12674 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:01:04.894361 12674 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:01:04.895181 12674 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:01:04.895386 12674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:01:04.903097 12674 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.188:33369
I20260502 20:01:04.903098 12744 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.188:33369 every 8 connection(s)
I20260502 20:01:04.904273 12674 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
I20260502 20:01:04.908567 12745 sys_catalog.cc:263] Verifying existing consensus state
I20260502 20:01:04.910236 12745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Bootstrap starting.
I20260502 20:01:04.911252 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 12674
I20260502 20:01:04.923314 12745 log.cc:826] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Log is configured to *not* fsync() on all Append() calls
I20260502 20:01:04.988116 12745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Bootstrap replayed 1/1 log segments. Stats: ops{read=120 overwritten=0 applied=120 ignored=0} inserts{seen=71 ignored=0} mutations{seen=105 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:01:04.988655 12745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Bootstrap complete.
I20260502 20:01:04.991513 12745 raft_consensus.cc:359] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:04.991881 12745 raft_consensus.cc:740] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: b470a66ad54f46b1b44a80dd1edf214e, State: Initialized, Role: FOLLOWER
I20260502 20:01:04.992404 12745 consensus_queue.cc:260] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 120, Last appended: 6.120, Last appended by leader: 120, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:04.993534 12750 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:04.993676 12750 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:01:04.993680 12745 sys_catalog.cc:565] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: configured and running, proceeding with master startup.
I20260502 20:01:04.997558 11043 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:01:05.001724 12765 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:01:05.001833 12765 catalog_manager.cc:1562] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: loading cluster ID for follower catalog manager: success
I20260502 20:01:05.002746 12708 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" instance_seqno: 1777752043533877) as {username='slave'} at 127.10.27.129:53909; Asking this server to re-register.
I20260502 20:01:05.000352 12674 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:01:05.003515 11043 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:05.003526 12674 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:01:05.005095 12765 catalog_manager.cc:1584] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: acquiring CA information for follower catalog manager: success
I20260502 20:01:05.005633 12708 ts_manager.cc:194] Registered new tserver with Master: 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:01:05.006999 12765 catalog_manager.cc:1612] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 20:01:05.096721 11178 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:01:05.098768 12708 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" instance_seqno: 1777752043728997) as {username='slave'} at 127.10.27.130:56459; Asking this server to re-register.
I20260502 20:01:05.099341 11178 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:05.100767 12708 ts_manager.cc:194] Registered new tserver with Master: b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:05.314970 11319 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:01:05.316303 12708 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ade741c4062940adb2223b55187ffe72" instance_seqno: 1777752043938024) as {username='slave'} at 127.10.27.131:46751; Asking this server to re-register.
I20260502 20:01:05.316772 11319 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:05.317951 12708 ts_manager.cc:194] Registered new tserver with Master: ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:01:05.355376 12773 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:05.355536 12773 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:05.356001 12773 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:01:05.357584 12557 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:05.360754 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ef9294b460014382a2a594c77f8900d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 128 } } ignore_live_leader: false dest_uuid: "b470a66ad54f46b1b44a80dd1edf214e" is_pre_election: true
I20260502 20:01:05.361258 12719 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9294b460014382a2a594c77f8900d4 in term 6.
I20260502 20:01:05.361845 12558 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec
I20260502 20:01:05.362174 12773 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260502 20:01:05.362249 12773 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:01:05.362284 12773 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 7 FOLLOWER]: Advancing to term 8
I20260502 20:01:05.364159 12773 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:05.364501 12773 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 election: Requested vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
I20260502 20:01:05.364920 12719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ef9294b460014382a2a594c77f8900d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 128 } } ignore_live_leader: false dest_uuid: "b470a66ad54f46b1b44a80dd1edf214e"
I20260502 20:01:05.365074 12719 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 6 FOLLOWER]: Advancing to term 8
W20260502 20:01:05.365821 12557 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:05.367085 12719 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9294b460014382a2a594c77f8900d4 in term 8.
I20260502 20:01:05.367472 12558 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec
I20260502 20:01:05.367650 12773 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260502 20:01:05.367870 12773 raft_consensus.cc:697] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 8 LEADER]: Becoming Leader. State: Replica: ef9294b460014382a2a594c77f8900d4, State: Running, Role: LEADER
I20260502 20:01:05.368225 12773 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 128, Committed index: 128, Last appended: 7.128, Last appended by leader: 128, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:05.370249 12777 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef9294b460014382a2a594c77f8900d4. Latest consensus state: current_term: 8 leader_uuid: "ef9294b460014382a2a594c77f8900d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:05.370381 12777 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: LEADER
I20260502 20:01:05.370728 12779 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 20:01:05.372779 12779 catalog_manager.cc:679] Loaded metadata for table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc]
I20260502 20:01:05.373189 12779 catalog_manager.cc:679] Loaded metadata for table default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]
I20260502 20:01:05.373500 12779 catalog_manager.cc:679] Loaded metadata for table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]
I20260502 20:01:05.373777 12779 catalog_manager.cc:679] Loaded metadata for table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]
I20260502 20:01:05.374060 12779 catalog_manager.cc:679] Loaded metadata for table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]
I20260502 20:01:05.374349 12779 catalog_manager.cc:679] Loaded metadata for table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]
I20260502 20:01:05.374588 12779 catalog_manager.cc:679] Loaded metadata for table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]
I20260502 20:01:05.374809 12779 catalog_manager.cc:679] Loaded metadata for table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]
I20260502 20:01:05.375106 12779 catalog_manager.cc:679] Loaded metadata for table default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150]
I20260502 20:01:05.375738 12779 catalog_manager.cc:679] Loaded metadata for table default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]
I20260502 20:01:05.376058 12779 catalog_manager.cc:679] Loaded metadata for table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f]
I20260502 20:01:05.376312 12779 catalog_manager.cc:679] Loaded metadata for table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2]
I20260502 20:01:05.376571 12779 catalog_manager.cc:679] Loaded metadata for table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63]
I20260502 20:01:05.376807 12779 catalog_manager.cc:679] Loaded metadata for table default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b]
I20260502 20:01:05.377054 12779 catalog_manager.cc:679] Loaded metadata for table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]
I20260502 20:01:05.378465 12779 tablet_loader.cc:96] loaded metadata for tablet 08346b0845c4478d9040446f9ef06dc5 (table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064])
I20260502 20:01:05.378724 12779 tablet_loader.cc:96] loaded metadata for tablet 0ea263d32fd2405985d4514c2ff02a39 (table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f])
I20260502 20:01:05.378976 12779 tablet_loader.cc:96] loaded metadata for tablet 11548942c58f4c05bad32038a55b8f66 (table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63])
I20260502 20:01:05.379467 12779 tablet_loader.cc:96] loaded metadata for tablet 12e5086b6f174f8ca5cacfe9ee8e58ff (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464])
I20260502 20:01:05.379704 12779 tablet_loader.cc:96] loaded metadata for tablet 13960950103845d7a83411bbf67c62a0 (table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f])
I20260502 20:01:05.380348 12779 tablet_loader.cc:96] loaded metadata for tablet 3cdb6695c99e4da682e33b146b0e51ab (table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86])
I20260502 20:01:05.380633 12779 tablet_loader.cc:96] loaded metadata for tablet 517527573a1d40239755d762cb328e79 (table default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02])
I20260502 20:01:05.381002 12779 tablet_loader.cc:96] loaded metadata for tablet 7d4b56bf7bac4ec7840e05107fd49caa (table default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b])
I20260502 20:01:05.381597 12779 tablet_loader.cc:96] loaded metadata for tablet 9df3ebd756b248d0b92bad3259e7a122 (table default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150])
I20260502 20:01:05.381871 12779 tablet_loader.cc:96] loaded metadata for tablet a18f3a9b1f514513a807d0a919db1f20 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760])
I20260502 20:01:05.382213 12779 tablet_loader.cc:96] loaded metadata for tablet af5837b307bb43258aa75c9a947dd5c6 (table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b])
I20260502 20:01:05.383148 12779 tablet_loader.cc:96] loaded metadata for tablet cd6cf90f390a4d679bc1400d82e529f3 (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b])
I20260502 20:01:05.383514 12779 tablet_loader.cc:96] loaded metadata for tablet e43e158d448442d3811dbdfe82db47ca (table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2])
I20260502 20:01:05.383863 12779 tablet_loader.cc:96] loaded metadata for tablet f6de313115d04ebebe7c481d640c260e (table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc])
I20260502 20:01:05.384136 12779 tablet_loader.cc:96] loaded metadata for tablet faafd4c8dd3a4e2ebea018657480f840 (table default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee])
I20260502 20:01:05.384318 12779 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 20:01:05.385102 12779 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:01:05.385195 12779 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 20:01:05.385990 12779 catalog_manager.cc:1514] Loading token signing keys...
I20260502 20:01:05.386706 12779 catalog_manager.cc:6055] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Loaded TSK: 0
I20260502 20:01:05.387419 12779 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 20:01:05.388020 12779 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 20:01:05.388713 12779 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 24
I20260502 20:01:05.426914 12572 master_service.cc:954] ReplaceTablet: received request to replace tablet 13960950103845d7a83411bbf67c62a0 from {username='slave'} at 127.0.0.1:46678
I20260502 20:01:05.427178 12571 master_service.cc:954] ReplaceTablet: received request to replace tablet cd6cf90f390a4d679bc1400d82e529f3 from {username='slave'} at 127.0.0.1:46678
I20260502 20:01:05.427405 12569 master_service.cc:954] ReplaceTablet: received request to replace tablet 08346b0845c4478d9040446f9ef06dc5 from {username='slave'} at 127.0.0.1:46678
I20260502 20:01:05.427453 12567 master_service.cc:954] ReplaceTablet: received request to replace tablet 12e5086b6f174f8ca5cacfe9ee8e58ff from {username='slave'} at 127.0.0.1:46678
I20260502 20:01:05.427405 12570 master_service.cc:954] ReplaceTablet: received request to replace tablet 517527573a1d40239755d762cb328e79 from {username='slave'} at 127.0.0.1:46678
I20260502 20:01:05.427847 12566 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46678:
name: "default.Table_89adbf9d323b449db6deb0fa830829bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:01:05.428411 12568 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46678:
name: "default.Table_89091fe7dff644288a504e28216d5d69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:01:05.428581 12563 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46678:
table { table_name: "default.Table_24faf39307584530a038ed30536bd4c2" } new_table_name: "default.Table_b9b31b57bb724b299b6000678ee9e5a4" modify_external_catalogs: true
I20260502 20:01:05.428664 12565 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46678:
name: "default.Table_c1f90f27e25c436bb0c43af980cece1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:01:05.428887 12564 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46678:
table { table_name: "default.Table_115178421c134252971c7a71b1134464" } new_table_name: "default.Table_9b0b95067a6444d783041819f979eb27" modify_external_catalogs: true
I20260502 20:01:05.432024 12719 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Refusing update from remote peer ef9294b460014382a2a594c77f8900d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 120. Preceding OpId from leader: term: 8 index: 130. (index mismatch)
I20260502 20:01:05.433202 12773 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 129, Last known committed idx: 120, Time since last communication: 0.000s
W20260502 20:01:05.434393 12557 consensus_peers.cc:597] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 -> Peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Couldn't send request to peer 38315e4f56484666b5e54afad02498ec. Status: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260502 20:01:05.436260 12626 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 26, previous 26; dumping first 3 out of 13 received events: NotificationEvent(eventId=25, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_b19cf190454d42ff99d3fcab96f783b1, message={"server":"","servicePrincipal":"","db":"default","table":"table_b19cf190454d42ff99d3fcab96f783b1","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_b19cf190454d42ff99d3fcab96f783b1\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752048},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b19cf190454d42ff99d3fcab96f783b1\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b19cf190454d42ff99d3fcab96f783b1\",\"kudu.table_id\":\"33b0206efcd84429a0b2bc366a81e1fb\",\"transient_lastDdlTime\":\"1777752048\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=ALTER_TABLE, dbName=default, tableName=table_b9b31b57bb724b299b6000678ee9e5a4, message={"server":"","servicePrincipal":"","db":"default","table":"table_24faf39307584530a038ed30536bd4c2","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_24faf39307584530a038ed30536bd4c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_24faf39307584530a038ed30536bd4c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_24faf39307584530a038ed30536bd4c2\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_b9b31b57bb724b299b6000678ee9e5a4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b9b31b57bb724b299b6000678ee9e5a4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b9b31b57bb724b299b6000678ee9e5a4\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1777752049}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_8ad450efb0df42d2bb35c3f8d3e0b78e, message={"server":"","servicePrincipal":"","db":"default","table":"table_8ad450efb0df42d2bb35c3f8d3e0b78e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752049},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_8ad450efb0df42d2bb35c3f8d3e0b78e\",\"kudu.table_id\":\"7d9fa0bb8a9b4877b6bbbac853119f8d\",\"transient_lastDdlTime\":\"1777752049\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f9b63204dcd google::LogMessage::Fail() at ??:0
I20260502 20:01:05.440444 12750 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef9294b460014382a2a594c77f8900d4. Latest consensus state: current_term: 8 leader_uuid: "ef9294b460014382a2a594c77f8900d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:05.440595 12750 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:01:05.440711 12750 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "ef9294b460014382a2a594c77f8900d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:05.440785 12750 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f9b63208b93 google::LogMessage::SendToLog() at ??:0
I20260502 20:01:05.442076 12780 mvcc.cc:204] Tried to move back new op lower bound from 7281672460010713088 to 7281672459750805504. Current Snapshot: MvccSnapshot[applied={T|T < 7281672460001472512}]
I20260502 20:01:05.442436 12782 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "ef9294b460014382a2a594c77f8900d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:05.442553 12782 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: LEADER
I20260502 20:01:05.443945 12750 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "ef9294b460014382a2a594c77f8900d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:05.444085 12750 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f9b632047cc google::LogMessage::Flush() at ??:0
I20260502 20:01:05.445844 12570 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet 517527573a1d40239755d762cb328e79
I20260502 20:01:05.446048 12572 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet 13960950103845d7a83411bbf67c62a0
I20260502 20:01:05.445844 12571 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet cd6cf90f390a4d679bc1400d82e529f3
@ 0x7f9b63204a11 google::LogMessage::~LogMessage() at ??:0
I20260502 20:01:05.447113 12570 catalog_manager.cc:6741] ReplaceTablet: tablet 517527573a1d40239755d762cb328e79 deleted and replaced by tablet 5af60ba1c00442a798b20b2470f9216a
I20260502 20:01:05.447127 12787 mvcc.cc:204] Tried to move back new op lower bound from 7281672460010713088 to 7281672433414365184. Current Snapshot: MvccSnapshot[applied={T|T < 7281672460001472512}]
I20260502 20:01:05.447448 12570 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46678:
table { table_name: "default.Table_ae16bd7eeae84bcc9df91b677d29e577" } modify_external_catalogs: true
I20260502 20:01:05.447589 12570 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46678:
table { table_name: "default.Table_ae16bd7eeae84bcc9df91b677d29e577" } modify_external_catalogs: true
I20260502 20:01:05.448282 12572 catalog_manager.cc:6741] ReplaceTablet: tablet 13960950103845d7a83411bbf67c62a0 deleted and replaced by tablet 218dfac06cf841c6aced6781154f283a
I20260502 20:01:05.448452 12572 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46678:
table { table_name: "default.Table_e3ad181715724e36aa7276f9790d41bf" } new_table_name: "default.Table_9fb8cc097c6f4bd48e5f41dd70218be1" modify_external_catalogs: true
I20260502 20:01:05.450013 12571 catalog_manager.cc:6741] ReplaceTablet: tablet cd6cf90f390a4d679bc1400d82e529f3 deleted and replaced by tablet c3ab3bbc37b94d6f97081c8fd069749a
I20260502 20:01:05.450266 12571 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46678:
table { table_name: "default.Table_d4efc4ecb8b04c828595edb245352971" } new_table_name: "default.Table_fd2a46a7a29e42429193d222c7c5037f" modify_external_catalogs: true
I20260502 20:01:05.450950 12567 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet 12e5086b6f174f8ca5cacfe9ee8e58ff
I20260502 20:01:05.451159 12569 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet 08346b0845c4478d9040446f9ef06dc5
I20260502 20:01:05.451279 12567 catalog_manager.cc:6741] ReplaceTablet: tablet 12e5086b6f174f8ca5cacfe9ee8e58ff deleted and replaced by tablet 0fd6383acb6e4ebc832cfe39903108b9
I20260502 20:01:05.451457 12567 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46678:
table { table_name: "default.Table_0d8473dff6e244c199473f589d46be1b" } new_table_name: "default.Table_41eddb5da0424c5ea3a77e1f59af0916" modify_external_catalogs: true
I20260502 20:01:05.451562 12569 catalog_manager.cc:6741] ReplaceTablet: tablet 08346b0845c4478d9040446f9ef06dc5 deleted and replaced by tablet 26352d15574149da915d302b3a322a46
I20260502 20:01:05.451870 12569 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46678:
name: "default.Table_2eef3c375d5248539d96b67ea8bbc2be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7f9b68778433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 20:01:05.456925 11249 tablet_service.cc:1558] Processing DeleteTablet for tablet 517527573a1d40239755d762cb328e79 with delete_type TABLET_DATA_DELETED (replaced by tablet 5af60ba1c00442a798b20b2470f9216a) from {username='slave'} at 127.0.0.1:51028
I20260502 20:01:05.457224 11250 tablet_service.cc:1558] Processing DeleteTablet for tablet 13960950103845d7a83411bbf67c62a0 with delete_type TABLET_DATA_DELETED (replaced by tablet 218dfac06cf841c6aced6781154f283a) from {username='slave'} at 127.0.0.1:51028
I20260502 20:01:05.457417 11246 tablet_service.cc:1558] Processing DeleteTablet for tablet cd6cf90f390a4d679bc1400d82e529f3 with delete_type TABLET_DATA_DELETED (replaced by tablet c3ab3bbc37b94d6f97081c8fd069749a) from {username='slave'} at 127.0.0.1:51028
I20260502 20:01:05.457531 11252 tablet_service.cc:1558] Processing DeleteTablet for tablet 12e5086b6f174f8ca5cacfe9ee8e58ff with delete_type TABLET_DATA_DELETED (replaced by tablet 0fd6383acb6e4ebc832cfe39903108b9) from {username='slave'} at 127.0.0.1:51028
I20260502 20:01:05.457634 11247 tablet_service.cc:1558] Processing DeleteTablet for tablet 08346b0845c4478d9040446f9ef06dc5 with delete_type TABLET_DATA_DELETED (replaced by tablet 26352d15574149da915d302b3a322a46) from {username='slave'} at 127.0.0.1:51028
@ 0x7f9b6877734a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 20:01:05.460973 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet 517527573a1d40239755d762cb328e79 with delete_type TABLET_DATA_DELETED (replaced by tablet 5af60ba1c00442a798b20b2470f9216a) from {username='slave'} at 127.0.0.1:44482
I20260502 20:01:05.460968 10972 tablet_service.cc:1558] Processing DeleteTablet for tablet 12e5086b6f174f8ca5cacfe9ee8e58ff with delete_type TABLET_DATA_DELETED (replaced by tablet 0fd6383acb6e4ebc832cfe39903108b9) from {username='slave'} at 127.0.0.1:44482
I20260502 20:01:05.461295 10976 tablet_service.cc:1558] Processing DeleteTablet for tablet 13960950103845d7a83411bbf67c62a0 with delete_type TABLET_DATA_DELETED (replaced by tablet 218dfac06cf841c6aced6781154f283a) from {username='slave'} at 127.0.0.1:44482
I20260502 20:01:05.461413 10975 tablet_service.cc:1558] Processing DeleteTablet for tablet cd6cf90f390a4d679bc1400d82e529f3 with delete_type TABLET_DATA_DELETED (replaced by tablet c3ab3bbc37b94d6f97081c8fd069749a) from {username='slave'} at 127.0.0.1:44482
I20260502 20:01:05.461519 10973 tablet_service.cc:1558] Processing DeleteTablet for tablet 08346b0845c4478d9040446f9ef06dc5 with delete_type TABLET_DATA_DELETED (replaced by tablet 26352d15574149da915d302b3a322a46) from {username='slave'} at 127.0.0.1:44482
@ 0x7f9b68776aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 20:01:05.462762 10975 tablet_service.cc:1511] Processing CreateTablet for tablet 5af60ba1c00442a798b20b2470f9216a (DEFAULT_TABLE table=default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.462996 11247 tablet_service.cc:1511] Processing CreateTablet for tablet 218dfac06cf841c6aced6781154f283a (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.463136 10976 tablet_service.cc:1511] Processing CreateTablet for tablet c3ab3bbc37b94d6f97081c8fd069749a (DEFAULT_TABLE table=default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.463287 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af60ba1c00442a798b20b2470f9216a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:05.463308 11247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218dfac06cf841c6aced6781154f283a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:05.463438 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ab3bbc37b94d6f97081c8fd069749a. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f9b6877c1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x55611e83b244 std::function<>::operator()() at ??:0
I20260502 20:01:05.463136 10973 tablet_service.cc:1511] Processing CreateTablet for tablet 218dfac06cf841c6aced6781154f283a (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.466269 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218dfac06cf841c6aced6781154f283a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:05.466310 11252 tablet_service.cc:1511] Processing CreateTablet for tablet 5af60ba1c00442a798b20b2470f9216a (DEFAULT_TABLE table=default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.466578 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af60ba1c00442a798b20b2470f9216a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:05.466792 11109 tablet_service.cc:1558] Processing DeleteTablet for tablet 517527573a1d40239755d762cb328e79 with delete_type TABLET_DATA_DELETED (replaced by tablet 5af60ba1c00442a798b20b2470f9216a) from {username='slave'} at 127.0.0.1:46744
I20260502 20:01:05.467087 11108 tablet_service.cc:1558] Processing DeleteTablet for tablet 12e5086b6f174f8ca5cacfe9ee8e58ff with delete_type TABLET_DATA_DELETED (replaced by tablet 0fd6383acb6e4ebc832cfe39903108b9) from {username='slave'} at 127.0.0.1:46744
I20260502 20:01:05.467198 11107 tablet_service.cc:1558] Processing DeleteTablet for tablet 13960950103845d7a83411bbf67c62a0 with delete_type TABLET_DATA_DELETED (replaced by tablet 218dfac06cf841c6aced6781154f283a) from {username='slave'} at 127.0.0.1:46744
I20260502 20:01:05.467351 11111 tablet_service.cc:1558] Processing DeleteTablet for tablet cd6cf90f390a4d679bc1400d82e529f3 with delete_type TABLET_DATA_DELETED (replaced by tablet c3ab3bbc37b94d6f97081c8fd069749a) from {username='slave'} at 127.0.0.1:46744
I20260502 20:01:05.467401 11109 tablet_service.cc:1511] Processing CreateTablet for tablet 5af60ba1c00442a798b20b2470f9216a (DEFAULT_TABLE table=default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.467658 11109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af60ba1c00442a798b20b2470f9216a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:05.468415 11110 tablet_service.cc:1558] Processing DeleteTablet for tablet 08346b0845c4478d9040446f9ef06dc5 with delete_type TABLET_DATA_DELETED (replaced by tablet 26352d15574149da915d302b3a322a46) from {username='slave'} at 127.0.0.1:46744
I20260502 20:01:05.468693 11112 tablet_service.cc:1511] Processing CreateTablet for tablet 218dfac06cf841c6aced6781154f283a (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.468741 11246 tablet_service.cc:1511] Processing CreateTablet for tablet c3ab3bbc37b94d6f97081c8fd069749a (DEFAULT_TABLE table=default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.468930 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 218dfac06cf841c6aced6781154f283a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:05.468989 11246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ab3bbc37b94d6f97081c8fd069749a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:05.471236 11106 tablet_service.cc:1511] Processing CreateTablet for tablet c3ab3bbc37b94d6f97081c8fd069749a (DEFAULT_TABLE table=default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.471331 12804 tablet_replica.cc:333] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:01:05.471475 12804 raft_consensus.cc:2243] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:05.471499 11106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ab3bbc37b94d6f97081c8fd069749a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:05.471596 12804 raft_consensus.cc:2272] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.472033 12804 ts_tablet_manager.cc:1916] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.472622 10973 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd6383acb6e4ebc832cfe39903108b9 (DEFAULT_TABLE table=default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.472914 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd6383acb6e4ebc832cfe39903108b9. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f9b647097ea kudu::Thread::SuperviseThread() at ??:0
I20260502 20:01:05.473524 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 26352d15574149da915d302b3a322a46 (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.473726 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26352d15574149da915d302b3a322a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:05.475512 11247 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd6383acb6e4ebc832cfe39903108b9 (DEFAULT_TABLE table=default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.475732 11106 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd6383acb6e4ebc832cfe39903108b9 (DEFAULT_TABLE table=default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.475802 11247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd6383acb6e4ebc832cfe39903108b9. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f9b6504d6db start_thread at ??:0
I20260502 20:01:05.476368 11112 tablet_service.cc:1511] Processing CreateTablet for tablet 26352d15574149da915d302b3a322a46 (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.476775 11106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd6383acb6e4ebc832cfe39903108b9. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f9b623bb61f clone at ??:0
I20260502 20:01:05.478137 12805 tablet_replica.cc:333] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:05.478268 12805 raft_consensus.cc:2243] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:01:05.478536 12805 raft_consensus.cc:2272] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.478645 11112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26352d15574149da915d302b3a322a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:05.479068 12804 ts_tablet_manager.cc:1929] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.479233 12804 log.cc:1199] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/517527573a1d40239755d762cb328e79
I20260502 20:01:05.479306 12805 ts_tablet_manager.cc:1916] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.479362 11252 tablet_service.cc:1511] Processing CreateTablet for tablet 26352d15574149da915d302b3a322a46 (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:05.479506 12804 ts_tablet_manager.cc:1950] T 517527573a1d40239755d762cb328e79 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:01:05.479597 11252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26352d15574149da915d302b3a322a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:05.480173 12804 tablet_replica.cc:333] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:01:05.480284 12804 raft_consensus.cc:2243] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:05.480381 12804 raft_consensus.cc:2272] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.480760 12804 ts_tablet_manager.cc:1916] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.481516 12805 ts_tablet_manager.cc:1929] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.481585 12805 log.cc:1199] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/517527573a1d40239755d762cb328e79
I20260502 20:01:05.482045 12805 ts_tablet_manager.cc:1950] T 517527573a1d40239755d762cb328e79 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:05.482442 12807 tablet_bootstrap.cc:492] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:01:05.482481 12808 tablet_bootstrap.cc:492] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:01:05.482823 12805 tablet_replica.cc:333] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:05.482952 12805 raft_consensus.cc:2243] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:05.482980 12804 ts_tablet_manager.cc:1929] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.483049 12804 log.cc:1199] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/13960950103845d7a83411bbf67c62a0
I20260502 20:01:05.483067 12805 raft_consensus.cc:2272] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.483302 12804 ts_tablet_manager.cc:1950] T 13960950103845d7a83411bbf67c62a0 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:01:05.483423 12805 ts_tablet_manager.cc:1916] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.483669 12807 tablet_bootstrap.cc:654] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.483685 12808 tablet_bootstrap.cc:654] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.484452 12809 tablet_replica.cc:333] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:05.484598 12809 raft_consensus.cc:2243] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:05.484719 12809 raft_consensus.cc:2272] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.484766 12807 tablet_bootstrap.cc:492] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:01:05.484841 12807 ts_tablet_manager.cc:1403] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260502 20:01:05.485093 12809 ts_tablet_manager.cc:1916] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.485365 12805 ts_tablet_manager.cc:1929] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.485416 12805 log.cc:1199] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/12e5086b6f174f8ca5cacfe9ee8e58ff
I20260502 20:01:05.485333 12807 raft_consensus.cc:359] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.485456 12807 raft_consensus.cc:385] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.485495 12807 raft_consensus.cc:740] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.485668 12805 ts_tablet_manager.cc:1950] T 12e5086b6f174f8ca5cacfe9ee8e58ff P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:05.485670 12807 consensus_queue.cc:260] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.486483 12805 tablet_replica.cc:333] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:05.487673 12807 ts_tablet_manager.cc:1434] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 20:01:05.488198 12810 tablet_bootstrap.cc:492] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:01:05.488466 12807 tablet_bootstrap.cc:492] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:01:05.489365 12810 tablet_bootstrap.cc:654] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.489470 12807 tablet_bootstrap.cc:654] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.490094 12805 raft_consensus.cc:2243] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:01:05.490307 12805 raft_consensus.cc:2272] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.490377 12809 ts_tablet_manager.cc:1929] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.490443 12809 log.cc:1199] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/517527573a1d40239755d762cb328e79
I20260502 20:01:05.490648 12805 ts_tablet_manager.cc:1916] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.490712 12808 tablet_bootstrap.cc:492] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:01:05.490754 12809 ts_tablet_manager.cc:1950] T 517527573a1d40239755d762cb328e79 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:05.490793 12808 ts_tablet_manager.cc:1403] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260502 20:01:05.491353 12808 raft_consensus.cc:359] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.491467 12808 raft_consensus.cc:385] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.491508 12808 raft_consensus.cc:740] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.491516 12804 tablet_replica.cc:333] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:01:05.491636 12804 raft_consensus.cc:2243] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:01:05.491654 12808 consensus_queue.cc:260] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.491837 12804 raft_consensus.cc:2272] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.493137 12805 ts_tablet_manager.cc:1929] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.493721 12808 ts_tablet_manager.cc:1434] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260502 20:01:05.494238 12809 tablet_replica.cc:333] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:05.494297 12808 tablet_bootstrap.cc:492] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:01:05.494360 12809 raft_consensus.cc:2243] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:05.494470 12809 raft_consensus.cc:2272] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.494993 12809 ts_tablet_manager.cc:1916] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.495592 12808 tablet_bootstrap.cc:654] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.495776 12805 log.cc:1199] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/13960950103845d7a83411bbf67c62a0
I20260502 20:01:05.496068 12805 ts_tablet_manager.cc:1950] T 13960950103845d7a83411bbf67c62a0 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:05.496773 12804 ts_tablet_manager.cc:1916] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.497298 12809 ts_tablet_manager.cc:1929] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.497364 12809 log.cc:1199] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/12e5086b6f174f8ca5cacfe9ee8e58ff
I20260502 20:01:05.497608 12809 ts_tablet_manager.cc:1950] T 12e5086b6f174f8ca5cacfe9ee8e58ff P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:05.498354 12805 tablet_replica.cc:333] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:05.498409 12809 tablet_replica.cc:333] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:05.498481 12805 raft_consensus.cc:2243] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:05.498515 12809 raft_consensus.cc:2243] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:05.498545 12810 tablet_bootstrap.cc:492] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:01:05.498581 12805 raft_consensus.cc:2272] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.498612 12810 ts_tablet_manager.cc:1403] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260502 20:01:05.498615 12809 raft_consensus.cc:2272] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.498665 12807 tablet_bootstrap.cc:492] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:01:05.498733 12807 ts_tablet_manager.cc:1403] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260502 20:01:05.498901 12805 ts_tablet_manager.cc:1916] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.499022 12809 ts_tablet_manager.cc:1916] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.499179 12810 raft_consensus.cc:359] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.499277 12810 raft_consensus.cc:385] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.499310 12810 raft_consensus.cc:740] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.499269 12807 raft_consensus.cc:359] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.499358 12807 raft_consensus.cc:385] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.499429 12807 raft_consensus.cc:740] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.499431 12810 consensus_queue.cc:260] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.499701 12810 ts_tablet_manager.cc:1434] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:01:05.499905 12810 tablet_bootstrap.cc:492] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:01:05.501157 12805 ts_tablet_manager.cc:1929] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.501227 12805 log.cc:1199] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/cd6cf90f390a4d679bc1400d82e529f3
I20260502 20:01:05.501260 12810 tablet_bootstrap.cc:654] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.501480 12805 ts_tablet_manager.cc:1950] T cd6cf90f390a4d679bc1400d82e529f3 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:05.499553 12807 consensus_queue.cc:260] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.503206 12809 ts_tablet_manager.cc:1929] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.503278 12809 log.cc:1199] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/13960950103845d7a83411bbf67c62a0
I20260502 20:01:05.503539 12809 ts_tablet_manager.cc:1950] T 13960950103845d7a83411bbf67c62a0 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:05.505092 12809 tablet_replica.cc:333] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:05.505215 12809 raft_consensus.cc:2243] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:05.505314 12809 raft_consensus.cc:2272] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.505679 12809 ts_tablet_manager.cc:1916] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.506610 12804 ts_tablet_manager.cc:1929] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.506661 12807 ts_tablet_manager.cc:1434] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260502 20:01:05.506683 12804 log.cc:1199] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/cd6cf90f390a4d679bc1400d82e529f3
I20260502 20:01:05.506982 12804 ts_tablet_manager.cc:1950] T cd6cf90f390a4d679bc1400d82e529f3 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:01:05.507706 12808 tablet_bootstrap.cc:492] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:01:05.507730 12809 ts_tablet_manager.cc:1929] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.507795 12809 log.cc:1199] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/cd6cf90f390a4d679bc1400d82e529f3
I20260502 20:01:05.507794 12808 ts_tablet_manager.cc:1403] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20260502 20:01:05.508139 12809 ts_tablet_manager.cc:1950] T cd6cf90f390a4d679bc1400d82e529f3 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:05.508376 12805 tablet_replica.cc:333] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:05.508347 12808 raft_consensus.cc:359] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.508448 12808 raft_consensus.cc:385] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.508488 12808 raft_consensus.cc:740] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.508523 12805 raft_consensus.cc:2243] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:01:05.508621 12808 consensus_queue.cc:260] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.508723 12805 raft_consensus.cc:2272] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.508971 12808 ts_tablet_manager.cc:1434] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:01:05.509114 12805 ts_tablet_manager.cc:1916] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.509171 12808 tablet_bootstrap.cc:492] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:01:05.509810 12807 tablet_bootstrap.cc:492] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:01:05.510183 12808 tablet_bootstrap.cc:654] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.511370 12805 ts_tablet_manager.cc:1929] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.511432 12805 log.cc:1199] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/08346b0845c4478d9040446f9ef06dc5
I20260502 20:01:05.511667 12805 ts_tablet_manager.cc:1950] T 08346b0845c4478d9040446f9ef06dc5 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:05.512185 12808 tablet_bootstrap.cc:492] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:01:05.512276 12808 ts_tablet_manager.cc:1403] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260502 20:01:05.512796 12807 tablet_bootstrap.cc:654] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.512770 12808 raft_consensus.cc:359] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.512867 12808 raft_consensus.cc:385] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.512898 12808 raft_consensus.cc:740] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.513046 12808 consensus_queue.cc:260] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.513350 12808 ts_tablet_manager.cc:1434] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:01:05.513533 12808 tablet_bootstrap.cc:492] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:01:05.513862 12807 tablet_bootstrap.cc:492] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:01:05.513944 12807 ts_tablet_manager.cc:1403] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 20:01:05.514487 12808 tablet_bootstrap.cc:654] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.514418 12807 raft_consensus.cc:359] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.514528 12807 raft_consensus.cc:385] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.514564 12807 raft_consensus.cc:740] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.514721 12807 consensus_queue.cc:260] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.516371 12809 tablet_replica.cc:333] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:05.516402 12804 tablet_replica.cc:333] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:01:05.516500 12809 raft_consensus.cc:2243] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:05.516533 12804 raft_consensus.cc:2243] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:01:05.516605 12809 raft_consensus.cc:2272] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.516695 12804 raft_consensus.cc:2272] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.517000 12809 ts_tablet_manager.cc:1916] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.517038 12804 ts_tablet_manager.cc:1916] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.519412 12804 ts_tablet_manager.cc:1929] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.519493 12804 log.cc:1199] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/12e5086b6f174f8ca5cacfe9ee8e58ff
I20260502 20:01:05.519613 12810 tablet_bootstrap.cc:492] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:01:05.519699 12810 ts_tablet_manager.cc:1403] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.002s
I20260502 20:01:05.519757 12804 ts_tablet_manager.cc:1950] T 12e5086b6f174f8ca5cacfe9ee8e58ff P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:01:05.520120 12807 ts_tablet_manager.cc:1434] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260502 20:01:05.520274 12810 raft_consensus.cc:359] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.520368 12807 tablet_bootstrap.cc:492] T 0fd6383acb6e4ebc832cfe39903108b9 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:01:05.520388 12810 raft_consensus.cc:385] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.520422 12810 raft_consensus.cc:740] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.520550 12810 consensus_queue.cc:260] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.520810 12810 ts_tablet_manager.cc:1434] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:01:05.521013 12810 tablet_bootstrap.cc:492] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:01:05.521507 12807 tablet_bootstrap.cc:654] T 0fd6383acb6e4ebc832cfe39903108b9 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.521979 12810 tablet_bootstrap.cc:654] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.524340 12804 tablet_replica.cc:333] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72: stopping tablet replica
I20260502 20:01:05.524473 12804 raft_consensus.cc:2243] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:05.525113 12809 ts_tablet_manager.cc:1929] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.525184 12809 log.cc:1199] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/08346b0845c4478d9040446f9ef06dc5
I20260502 20:01:05.525357 12807 tablet_bootstrap.cc:492] T 0fd6383acb6e4ebc832cfe39903108b9 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:01:05.525439 12809 ts_tablet_manager.cc:1950] T 08346b0845c4478d9040446f9ef06dc5 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:05.525458 12807 ts_tablet_manager.cc:1403] T 0fd6383acb6e4ebc832cfe39903108b9 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260502 20:01:05.525657 12804 raft_consensus.cc:2272] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:05.526144 12804 ts_tablet_manager.cc:1916] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:05.526081 12807 raft_consensus.cc:359] T 0fd6383acb6e4ebc832cfe39903108b9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.526212 12807 raft_consensus.cc:385] T 0fd6383acb6e4ebc832cfe39903108b9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.526252 12807 raft_consensus.cc:740] T 0fd6383acb6e4ebc832cfe39903108b9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.526440 12807 consensus_queue.cc:260] T 0fd6383acb6e4ebc832cfe39903108b9 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.527232 12808 tablet_bootstrap.cc:492] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:01:05.527328 12808 ts_tablet_manager.cc:1403] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260502 20:01:05.527825 12808 raft_consensus.cc:359] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.527928 12808 raft_consensus.cc:385] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.527966 12808 raft_consensus.cc:740] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.528082 12808 consensus_queue.cc:260] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.528378 12808 ts_tablet_manager.cc:1434] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:01:05.528513 12804 ts_tablet_manager.cc:1929] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:05.528578 12804 log.cc:1199] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-2/wal/wals/08346b0845c4478d9040446f9ef06dc5
I20260502 20:01:05.528596 12808 tablet_bootstrap.cc:492] T 0fd6383acb6e4ebc832cfe39903108b9 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:01:05.528825 12804 ts_tablet_manager.cc:1950] T 08346b0845c4478d9040446f9ef06dc5 P ade741c4062940adb2223b55187ffe72: Deleting consensus metadata
I20260502 20:01:05.529295 12807 ts_tablet_manager.cc:1434] T 0fd6383acb6e4ebc832cfe39903108b9 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260502 20:01:05.529786 12808 tablet_bootstrap.cc:654] T 0fd6383acb6e4ebc832cfe39903108b9 P ade741c4062940adb2223b55187ffe72: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.530407 12807 tablet_bootstrap.cc:492] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:01:05.531685 12807 tablet_bootstrap.cc:654] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.532727 12810 tablet_bootstrap.cc:492] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:01:05.532794 12808 tablet_bootstrap.cc:492] T 0fd6383acb6e4ebc832cfe39903108b9 P ade741c4062940adb2223b55187ffe72: No bootstrap required, opened a new log
I20260502 20:01:05.532817 12810 ts_tablet_manager.cc:1403] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20260502 20:01:05.533330 12810 raft_consensus.cc:359] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.533450 12810 raft_consensus.cc:385] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.533481 12810 raft_consensus.cc:740] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.533604 12810 consensus_queue.cc:260] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.533850 12810 ts_tablet_manager.cc:1434] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:01:05.533917 12808 ts_tablet_manager.cc:1403] T 0fd6383acb6e4ebc832cfe39903108b9 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260502 20:01:05.534046 12810 tablet_bootstrap.cc:492] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:01:05.534497 12808 raft_consensus.cc:359] T 0fd6383acb6e4ebc832cfe39903108b9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.534616 12808 raft_consensus.cc:385] T 0fd6383acb6e4ebc832cfe39903108b9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.534668 12808 raft_consensus.cc:740] T 0fd6383acb6e4ebc832cfe39903108b9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.534811 12808 consensus_queue.cc:260] T 0fd6383acb6e4ebc832cfe39903108b9 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.535049 12810 tablet_bootstrap.cc:654] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.535159 12808 ts_tablet_manager.cc:1434] T 0fd6383acb6e4ebc832cfe39903108b9 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:01:05.535846 12807 tablet_bootstrap.cc:492] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:01:05.535928 12807 ts_tablet_manager.cc:1403] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260502 20:01:05.537246 12807 raft_consensus.cc:359] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.537362 12807 raft_consensus.cc:385] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.537395 12807 raft_consensus.cc:740] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.537642 12807 consensus_queue.cc:260] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.537947 12807 ts_tablet_manager.cc:1434] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260502 20:01:05.538744 12810 tablet_bootstrap.cc:492] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:01:05.538823 12810 ts_tablet_manager.cc:1403] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260502 20:01:05.539489 12810 raft_consensus.cc:359] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.552474 12810 raft_consensus.cc:385] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.552557 12810 raft_consensus.cc:740] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.552732 12810 consensus_queue.cc:260] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.553100 12810 ts_tablet_manager.cc:1434] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260502 20:01:05.553356 12810 tablet_bootstrap.cc:492] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:01:05.554687 12810 tablet_bootstrap.cc:654] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:05.557519 12810 tablet_bootstrap.cc:492] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:01:05.557614 12810 ts_tablet_manager.cc:1403] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 20:01:05.558116 12810 raft_consensus.cc:359] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.558229 12810 raft_consensus.cc:385] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:05.558269 12810 raft_consensus.cc:740] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:01:05.558415 12810 consensus_queue.cc:260] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.558768 12810 ts_tablet_manager.cc:1434] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:01:05.586349 12820 raft_consensus.cc:493] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:05.586480 12820 raft_consensus.cc:515] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.587168 12820 leader_election.cc:290] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:05.587630 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ab3bbc37b94d6f97081c8fd069749a" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:01:05.587641 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ab3bbc37b94d6f97081c8fd069749a" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:01:05.587797 11130 raft_consensus.cc:2468] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:01:05.587810 10982 raft_consensus.cc:2468] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:01:05.588172 11206 leader_election.cc:304] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:01:05.588339 12820 raft_consensus.cc:2804] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:01:05.588413 12820 raft_consensus.cc:493] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:01:05.588475 12820 raft_consensus.cc:3060] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.589345 12820 raft_consensus.cc:515] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.589756 12820 leader_election.cc:290] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:05.589886 12515 raft_consensus.cc:493] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:05.589953 12515 raft_consensus.cc:515] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.590183 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ab3bbc37b94d6f97081c8fd069749a" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:01:05.590183 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ab3bbc37b94d6f97081c8fd069749a" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:01:05.590296 12515 leader_election.cc:290] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:05.590296 11130 raft_consensus.cc:3060] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.590337 10982 raft_consensus.cc:3060] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.590790 10995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218dfac06cf841c6aced6781154f283a" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:01:05.590902 10995 raft_consensus.cc:2468] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:01:05.591233 11206 leader_election.cc:304] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:01:05.591441 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218dfac06cf841c6aced6781154f283a" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:01:05.591548 11130 raft_consensus.cc:2468] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:01:05.591638 12820 raft_consensus.cc:2804] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:01:05.591682 12820 raft_consensus.cc:493] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:01:05.591723 12820 raft_consensus.cc:3060] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.591743 10982 raft_consensus.cc:2468] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:01:05.591557 11131 raft_consensus.cc:2468] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 0.
I20260502 20:01:05.592113 11209 leader_election.cc:304] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:01:05.592423 12515 raft_consensus.cc:2804] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:01:05.592648 12515 raft_consensus.cc:697] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Becoming Leader. State: Replica: ade741c4062940adb2223b55187ffe72, State: Running, Role: LEADER
I20260502 20:01:05.592667 12820 raft_consensus.cc:515] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.592803 12515 consensus_queue.cc:237] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.593421 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218dfac06cf841c6aced6781154f283a" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:01:05.593529 10982 raft_consensus.cc:3060] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.593673 12820 leader_election.cc:290] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:05.594050 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "218dfac06cf841c6aced6781154f283a" candidate_uuid: "ade741c4062940adb2223b55187ffe72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:01:05.594151 11131 raft_consensus.cc:3060] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.594482 10982 raft_consensus.cc:2468] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:01:05.595371 11131 raft_consensus.cc:2468] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade741c4062940adb2223b55187ffe72 in term 1.
I20260502 20:01:05.595697 11209 leader_election.cc:304] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:01:05.596179 12820 raft_consensus.cc:2804] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:01:05.596285 12820 raft_consensus.cc:697] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [term 1 LEADER]: Becoming Leader. State: Replica: ade741c4062940adb2223b55187ffe72, State: Running, Role: LEADER
I20260502 20:01:05.596413 12820 consensus_queue.cc:237] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.598897 12634 raft_consensus.cc:493] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:05.599134 12634 raft_consensus.cc:515] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.599606 12634 leader_election.cc:290] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:01:05.599967 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd6383acb6e4ebc832cfe39903108b9" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:01:05.600049 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd6383acb6e4ebc832cfe39903108b9" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:01:05.600093 11272 raft_consensus.cc:2468] T 0fd6383acb6e4ebc832cfe39903108b9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:01:05.600334 10982 raft_consensus.cc:2468] T 0fd6383acb6e4ebc832cfe39903108b9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:01:05.600513 11065 leader_election.cc:304] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade741c4062940adb2223b55187ffe72, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:01:05.600698 12634 raft_consensus.cc:2804] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:01:05.600785 12634 raft_consensus.cc:493] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:01:05.600843 12634 raft_consensus.cc:3060] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.601694 12634 raft_consensus.cc:515] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.602027 12634 leader_election.cc:290] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:01:05.602362 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd6383acb6e4ebc832cfe39903108b9" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:01:05.602427 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd6383acb6e4ebc832cfe39903108b9" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:01:05.602485 11272 raft_consensus.cc:3060] T 0fd6383acb6e4ebc832cfe39903108b9 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.602548 10982 raft_consensus.cc:3060] T 0fd6383acb6e4ebc832cfe39903108b9 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.603488 11272 raft_consensus.cc:2468] T 0fd6383acb6e4ebc832cfe39903108b9 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:01:05.603492 10982 raft_consensus.cc:2468] T 0fd6383acb6e4ebc832cfe39903108b9 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:01:05.603807 11065 leader_election.cc:304] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:01:05.603997 12634 raft_consensus.cc:2804] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:01:05.604177 12634 raft_consensus.cc:697] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:01:05.604344 12634 consensus_queue.cc:237] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
W20260502 20:01:05.678527 11208 connection.cc:570] server connection from 127.0.0.1:51028 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:05.678524 11068 connection.cc:570] server connection from 127.0.0.1:46744 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:05.678541 10932 connection.cc:570] server connection from 127.0.0.1:44482 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:05.678823 11065 connection.cc:570] client connection to 127.10.27.189:46281 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:05.678891 11206 connection.cc:570] client connection to 127.10.27.189:46281 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:05.679040 10930 connection.cc:570] client connection to 127.10.27.189:46281 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:05.680023 11326 connection.cc:570] client connection to 127.10.27.189:46281 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:05.680455 11326 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.10.27.189:46281)
W20260502 20:01:05.680814 11326 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.27.189:46281)
W20260502 20:01:05.681124 11326 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.10.27.189:46281)
W20260502 20:01:05.681408 11326 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.10.27.189:46281)
W20260502 20:01:05.681604 12770 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 20:01:05.679635 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.10.27.189:46281 (local address 127.10.27.130:57923)
0502 20:01:05.679743 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0502 20:01:05.679757 (+ 14us) client_negotiation.cc:175] Beginning negotiation
0502 20:01:05.679826 (+ 69us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 20:01:05.681483 (+ 1657us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":36}
W20260502 20:01:05.681975 12751 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 20:01:05.680171 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.10.27.189:46281 (local address 127.10.27.129:54973)
0502 20:01:05.680449 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0502 20:01:05.680465 (+ 16us) client_negotiation.cc:175] Beginning negotiation
0502 20:01:05.680554 (+ 89us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 20:01:05.681642 (+ 1088us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":190}
W20260502 20:01:05.682037 12772 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 20:01:05.679489 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.10.27.189:46281 (local address 127.10.27.131:56973)
0502 20:01:05.679711 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0502 20:01:05.679727 (+ 16us) client_negotiation.cc:175] Beginning negotiation
0502 20:01:05.679826 (+ 99us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 20:01:05.681931 (+ 2105us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":125}
I20260502 20:01:05.746707 12634 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:05.746869 12634 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.747298 12634 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:01:05.747819 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26352d15574149da915d302b3a322a46" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:01:05.747866 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26352d15574149da915d302b3a322a46" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:01:05.747993 10982 raft_consensus.cc:2468] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:01:05.747993 11272 raft_consensus.cc:2468] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:01:05.748319 11065 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:01:05.748590 12634 raft_consensus.cc:2804] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:01:05.748660 12634 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:01:05.748718 12634 raft_consensus.cc:3060] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.749383 12497 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:05.749503 12497 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.749773 12634 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.749971 12497 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:05.750162 12634 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:01:05.750455 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26352d15574149da915d302b3a322a46" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:01:05.750483 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af60ba1c00442a798b20b2470f9216a" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72" is_pre_election: true
I20260502 20:01:05.750514 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af60ba1c00442a798b20b2470f9216a" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1" is_pre_election: true
I20260502 20:01:05.750588 11273 raft_consensus.cc:3060] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.750602 11131 raft_consensus.cc:2468] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:01:05.750706 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26352d15574149da915d302b3a322a46" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:01:05.750602 11272 raft_consensus.cc:2468] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 0.
I20260502 20:01:05.750814 10982 raft_consensus.cc:3060] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.750901 10933 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:01:05.751658 11273 raft_consensus.cc:2468] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:01:05.751793 10982 raft_consensus.cc:2468] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:01:05.752085 12497 raft_consensus.cc:2804] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:01:05.752149 12497 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:01:05.752185 12497 raft_consensus.cc:3060] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.753118 12497 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.753505 12497 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:05.753822 11065 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:01:05.753866 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af60ba1c00442a798b20b2470f9216a" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade741c4062940adb2223b55187ffe72"
I20260502 20:01:05.753865 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af60ba1c00442a798b20b2470f9216a" candidate_uuid: "858db0bc9f07476e9d1540f2b095414f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b85d150f168f406bb31ff44150b2b1a1"
I20260502 20:01:05.753999 11273 raft_consensus.cc:3060] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.754136 12634 raft_consensus.cc:2804] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:01:05.754140 11131 raft_consensus.cc:3060] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:05.754272 12634 raft_consensus.cc:697] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:01:05.754645 12634 consensus_queue.cc:237] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.755046 11273 raft_consensus.cc:2468] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:01:05.755366 11131 raft_consensus.cc:2468] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 858db0bc9f07476e9d1540f2b095414f in term 1.
I20260502 20:01:05.755654 10930 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, ade741c4062940adb2223b55187ffe72; no voters:
I20260502 20:01:05.756098 12497 raft_consensus.cc:2804] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:01:05.756349 12497 raft_consensus.cc:697] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Becoming Leader. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Running, Role: LEADER
I20260502 20:01:05.756493 12497 consensus_queue.cc:237] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:05.971161 12845 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:05.971308 12845 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:05.972651 12845 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:05.973206 12694 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:05.974078 12693 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:05.974396 12694 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:05.974484 12694 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:05.974686 12845 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260502 20:01:05.976862 12820 consensus_queue.cc:1048] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:01:05.982133 12820 consensus_queue.cc:1048] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:01:06.039809 12634 consensus_queue.cc:1048] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:01:06.044421 12839 consensus_queue.cc:1048] T 0fd6383acb6e4ebc832cfe39903108b9 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:01:06.061218 12820 consensus_queue.cc:1048] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:01:06.066908 12515 consensus_queue.cc:1048] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:01:06.138769 12839 consensus_queue.cc:1048] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:01:06.143180 12634 consensus_queue.cc:1048] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:01:06.221872 12497 consensus_queue.cc:1048] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:01:06.226434 12497 consensus_queue.cc:1048] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:01:06.613817 12867 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:06.613952 12867 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:06.614480 12867 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:06.615725 12694 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:06.616111 12693 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:01:06.616245 12693 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:06.616470 12867 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260502 20:01:07.344442 10350 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu with pid 12674
I20260502 20:01:08.161612 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.188:33369
--webserver_interface=127.10.27.188
--webserver_port=35669
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 20:01:08.272747 12890 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:01:08.272986 12890 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:01:08.273028 12890 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:01:08.276788 12890 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 20:01:08.276859 12890 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:01:08.276882 12890 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 20:01:08.276901 12890 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 20:01:08.281119 12890 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.188:33369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.27.188
--webserver_port=35669
--never_fsync=true
--heap_profile_path=/tmp/kudu.12890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:01:08.282222 12890 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:01:08.283366 12890 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:01:08.289115 12895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:01:08.289098 12896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:01:08.289113 12898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:01:08.289496 12890 server_base.cc:1061] running on GCE node
I20260502 20:01:08.290072 12890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:01:08.291193 12890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:01:08.292400 12890 hybrid_clock.cc:648] HybridClock initialized: now 1777752068292384 us; error 33 us; skew 500 ppm
I20260502 20:01:08.294564 12890 webserver.cc:492] Webserver started at http://127.10.27.188:35669/ using document root <none> and password file <none>
I20260502 20:01:08.295431 12890 fs_manager.cc:362] Metadata directory not provided
I20260502 20:01:08.295504 12890 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:01:08.299444 12890 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260502 20:01:08.301731 12904 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:01:08.302834 12890 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260502 20:01:08.303017 12890 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
uuid: "b470a66ad54f46b1b44a80dd1edf214e"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:01:08.303442 12890 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:01:08.317775 12890 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:01:08.318481 12890 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:01:08.318681 12890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:01:08.326483 12890 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.188:33369
I20260502 20:01:08.326463 12957 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.188:33369 every 8 connection(s)
I20260502 20:01:08.327679 12890 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
I20260502 20:01:08.328641 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 12890
I20260502 20:01:08.331990 12958 sys_catalog.cc:263] Verifying existing consensus state
I20260502 20:01:08.333949 12958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Bootstrap starting.
I20260502 20:01:08.347149 12958 log.cc:826] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Log is configured to *not* fsync() on all Append() calls
I20260502 20:01:08.413972 12958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Bootstrap replayed 1/1 log segments. Stats: ops{read=136 overwritten=0 applied=136 ignored=0} inserts{seen=81 ignored=0} mutations{seen=125 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:01:08.414443 12958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Bootstrap complete.
I20260502 20:01:08.417508 12958 raft_consensus.cc:359] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:08.417850 12958 raft_consensus.cc:740] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: b470a66ad54f46b1b44a80dd1edf214e, State: Initialized, Role: FOLLOWER
I20260502 20:01:08.418401 12958 consensus_queue.cc:260] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 136, Last appended: 8.136, Last appended by leader: 136, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:08.418921 12962 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:08.419183 12962 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:01:08.419620 12958 sys_catalog.cc:565] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: configured and running, proceeding with master startup.
I20260502 20:01:08.424888 12890 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:01:08.426844 12976 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:01:08.426913 12976 catalog_manager.cc:1562] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: loading cluster ID for follower catalog manager: success
I20260502 20:01:08.426916 12890 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:01:08.429819 12976 catalog_manager.cc:1584] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: acquiring CA information for follower catalog manager: success
I20260502 20:01:08.431794 12976 catalog_manager.cc:1612] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 20:01:08.601087 11319 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:01:08.602736 12922 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ade741c4062940adb2223b55187ffe72" instance_seqno: 1777752043938024) as {username='slave'} at 127.10.27.131:54817; Asking this server to re-register.
I20260502 20:01:08.603343 11319 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:08.604800 12922 ts_manager.cc:194] Registered new tserver with Master: ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:01:08.745714 11178 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:01:08.746788 12922 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" instance_seqno: 1777752043728997) as {username='slave'} at 127.10.27.130:41949; Asking this server to re-register.
I20260502 20:01:08.747258 11178 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:08.748306 12922 ts_manager.cc:194] Registered new tserver with Master: b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:08.815294 11043 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:01:08.816694 12922 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" instance_seqno: 1777752043533877) as {username='slave'} at 127.10.27.129:32925; Asking this server to re-register.
I20260502 20:01:08.817248 11043 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:08.818557 12922 ts_manager.cc:194] Registered new tserver with Master: 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:01:08.965631 12983 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:08.965807 12983 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:08.967304 12983 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:08.967921 12907 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:08.968956 12907 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:08.969100 12906 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:01:08.969210 12906 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:08.969475 12983 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260502 20:01:09.565068 12991 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:09.565210 12991 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:09.565793 12991 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:09.567358 12906 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:09.567468 12907 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:09.567530 12907 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:09.567680 12991 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260502 20:01:10.351517 13008 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:10.351656 13008 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:10.352062 13008 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:10.353869 12906 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:10.353991 12907 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:10.354056 12907 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:10.354243 13008 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260502 20:01:11.493676 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.189:46281
--webserver_interface=127.10.27.189
--webserver_port=43275
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 20:01:11.615021 13024 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:01:11.615320 13024 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:01:11.615381 13024 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:01:11.618780 13024 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 20:01:11.618844 13024 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:01:11.618865 13024 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 20:01:11.618884 13024 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 20:01:11.623136 13024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.189:46281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.27.189
--webserver_port=43275
--never_fsync=true
--heap_profile_path=/tmp/kudu.13024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:01:11.624416 13024 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:01:11.625491 13024 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:01:11.631232 13032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:01:11.631232 13031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:01:11.631232 13034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:01:11.631596 13024 server_base.cc:1061] running on GCE node
I20260502 20:01:11.632074 13024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:01:11.632954 13024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:01:11.634114 13024 hybrid_clock.cc:648] HybridClock initialized: now 1777752071634093 us; error 34 us; skew 500 ppm
I20260502 20:01:11.636198 13024 webserver.cc:492] Webserver started at http://127.10.27.189:43275/ using document root <none> and password file <none>
I20260502 20:01:11.636796 13024 fs_manager.cc:362] Metadata directory not provided
I20260502 20:01:11.636853 13024 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:01:11.640534 13024 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260502 20:01:11.642625 13040 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:01:11.643685 13024 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260502 20:01:11.643810 13024 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
uuid: "ef9294b460014382a2a594c77f8900d4"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:01:11.644227 13024 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:01:11.665215 13024 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:01:11.666045 13024 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:01:11.666260 13024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:01:11.673906 13024 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.189:46281
I20260502 20:01:11.673928 13092 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.189:46281 every 8 connection(s)
I20260502 20:01:11.675041 13024 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-1/data/info.pb
I20260502 20:01:11.678978 13093 sys_catalog.cc:263] Verifying existing consensus state
I20260502 20:01:11.680588 13093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Bootstrap starting.
I20260502 20:01:11.681160 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 13024
I20260502 20:01:11.695538 13093 log.cc:826] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Log is configured to *not* fsync() on all Append() calls
I20260502 20:01:11.713882 13097 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:11.714018 13097 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:11.714529 13097 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:11.715960 12907 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:11.754832 11180 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:01:11.771811 13093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Bootstrap replayed 1/1 log segments. Stats: ops{read=136 overwritten=0 applied=136 ignored=0} inserts{seen=81 ignored=0} mutations{seen=125 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:01:11.772377 13093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Bootstrap complete.
I20260502 20:01:11.776736 13093 raft_consensus.cc:359] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:11.777210 13093 raft_consensus.cc:740] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9294b460014382a2a594c77f8900d4, State: Initialized, Role: FOLLOWER
I20260502 20:01:11.777689 13093 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 136, Last appended: 8.136, Last appended by leader: 136, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:11.778512 13104 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:11.778646 13104 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:01:11.779059 13093 sys_catalog.cc:565] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260502 20:01:11.779150 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b470a66ad54f46b1b44a80dd1edf214e" candidate_term: 9 candidate_status { last_received { term: 8 index: 136 } } ignore_live_leader: false dest_uuid: "ef9294b460014382a2a594c77f8900d4" is_pre_election: true
I20260502 20:01:11.779446 13067 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b470a66ad54f46b1b44a80dd1edf214e in term 8.
I20260502 20:01:11.780102 12906 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec
I20260502 20:01:11.780357 13097 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260502 20:01:11.780426 13097 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:01:11.780479 13097 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 8 FOLLOWER]: Advancing to term 9
I20260502 20:01:11.782713 13097 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:11.783279 13097 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 election: Requested vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
I20260502 20:01:11.783898 13067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b470a66ad54f46b1b44a80dd1edf214e" candidate_term: 9 candidate_status { last_received { term: 8 index: 136 } } ignore_live_leader: false dest_uuid: "ef9294b460014382a2a594c77f8900d4"
I20260502 20:01:11.784011 13067 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 8 FOLLOWER]: Advancing to term 9
W20260502 20:01:11.785797 12907 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:11.786149 13067 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b470a66ad54f46b1b44a80dd1edf214e in term 9.
I20260502 20:01:11.786599 12906 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec
I20260502 20:01:11.786870 13097 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 9 FOLLOWER]: Leader election won for term 9
I20260502 20:01:11.787145 13097 raft_consensus.cc:697] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 9 LEADER]: Becoming Leader. State: Replica: b470a66ad54f46b1b44a80dd1edf214e, State: Running, Role: LEADER
I20260502 20:01:11.787472 13097 consensus_queue.cc:237] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 136, Committed index: 136, Last appended: 8.136, Last appended by leader: 136, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:11.788040 13118 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:01:11.788084 13118 catalog_manager.cc:1562] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: loading cluster ID for follower catalog manager: success
I20260502 20:01:11.788897 13097 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b470a66ad54f46b1b44a80dd1edf214e. Latest consensus state: current_term: 9 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:11.788995 13097 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: LEADER
I20260502 20:01:11.790915 13118 catalog_manager.cc:1584] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: acquiring CA information for follower catalog manager: success
I20260502 20:01:11.789073 13024 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:01:11.791443 13024 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:01:11.793064 13118 catalog_manager.cc:1612] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 20:01:11.793390 13124 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 20:01:11.795265 13124 catalog_manager.cc:679] Loaded metadata for table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc]
I20260502 20:01:11.795634 13124 catalog_manager.cc:679] Loaded metadata for table default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]
I20260502 20:01:11.795878 13124 catalog_manager.cc:679] Loaded metadata for table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]
I20260502 20:01:11.796128 13124 catalog_manager.cc:679] Loaded metadata for table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]
I20260502 20:01:11.796361 13124 catalog_manager.cc:679] Loaded metadata for table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]
I20260502 20:01:11.796594 13124 catalog_manager.cc:679] Loaded metadata for table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]
I20260502 20:01:11.796859 13124 catalog_manager.cc:679] Loaded metadata for table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]
I20260502 20:01:11.797104 13124 catalog_manager.cc:679] Loaded metadata for table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]
I20260502 20:01:11.797353 13124 catalog_manager.cc:679] Loaded metadata for table default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150]
I20260502 20:01:11.797767 13124 catalog_manager.cc:679] Loaded metadata for table default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]
I20260502 20:01:11.798002 13124 catalog_manager.cc:679] Loaded metadata for table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f]
I20260502 20:01:11.798228 13124 catalog_manager.cc:679] Loaded metadata for table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2]
I20260502 20:01:11.798458 13124 catalog_manager.cc:679] Loaded metadata for table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63]
I20260502 20:01:11.798679 13124 catalog_manager.cc:679] Loaded metadata for table default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b]
I20260502 20:01:11.798909 13124 catalog_manager.cc:679] Loaded metadata for table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]
I20260502 20:01:11.800367 13124 tablet_loader.cc:96] loaded metadata for tablet 0ea263d32fd2405985d4514c2ff02a39 (table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f])
I20260502 20:01:11.800591 13124 tablet_loader.cc:96] loaded metadata for tablet 0fd6383acb6e4ebc832cfe39903108b9 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464])
I20260502 20:01:11.800942 13124 tablet_loader.cc:96] loaded metadata for tablet 11548942c58f4c05bad32038a55b8f66 (table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63])
I20260502 20:01:11.801373 13124 tablet_loader.cc:96] loaded metadata for tablet 218dfac06cf841c6aced6781154f283a (table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f])
I20260502 20:01:11.801658 13124 tablet_loader.cc:96] loaded metadata for tablet 26352d15574149da915d302b3a322a46 (table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064])
I20260502 20:01:11.802217 13124 tablet_loader.cc:96] loaded metadata for tablet 3cdb6695c99e4da682e33b146b0e51ab (table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86])
I20260502 20:01:11.802603 13124 tablet_loader.cc:96] loaded metadata for tablet 5af60ba1c00442a798b20b2470f9216a (table default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02])
I20260502 20:01:11.803047 13124 tablet_loader.cc:96] loaded metadata for tablet 7d4b56bf7bac4ec7840e05107fd49caa (table default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b])
I20260502 20:01:11.803861 13124 tablet_loader.cc:96] loaded metadata for tablet 9df3ebd756b248d0b92bad3259e7a122 (table default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150])
I20260502 20:01:11.804210 13124 tablet_loader.cc:96] loaded metadata for tablet a18f3a9b1f514513a807d0a919db1f20 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760])
I20260502 20:01:11.804526 13124 tablet_loader.cc:96] loaded metadata for tablet af5837b307bb43258aa75c9a947dd5c6 (table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b])
I20260502 20:01:11.805249 13124 tablet_loader.cc:96] loaded metadata for tablet c3ab3bbc37b94d6f97081c8fd069749a (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b])
I20260502 20:01:11.806020 13124 tablet_loader.cc:96] loaded metadata for tablet e43e158d448442d3811dbdfe82db47ca (table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2])
I20260502 20:01:11.806398 13124 tablet_loader.cc:96] loaded metadata for tablet f6de313115d04ebebe7c481d640c260e (table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc])
I20260502 20:01:11.806671 13124 tablet_loader.cc:96] loaded metadata for tablet faafd4c8dd3a4e2ebea018657480f840 (table default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee])
I20260502 20:01:11.806859 13124 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 20:01:11.807768 13124 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:01:11.807859 13124 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 20:01:11.808780 13124 catalog_manager.cc:1514] Loading token signing keys...
I20260502 20:01:11.809394 13124 catalog_manager.cc:6055] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Loaded TSK: 0
I20260502 20:01:11.810026 13124 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 20:01:11.810616 13124 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 20:01:11.811337 13124 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 24
I20260502 20:01:11.821832 11045 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:01:11.823633 13057 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" instance_seqno: 1777752043533877) as {username='slave'} at 127.10.27.129:60959; Asking this server to re-register.
I20260502 20:01:11.824378 11045 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:11.826191 13057 ts_manager.cc:194] Registered new tserver with Master: 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:01:11.865681 12920 master_service.cc:954] ReplaceTablet: received request to replace tablet 26352d15574149da915d302b3a322a46 from {username='slave'} at 127.0.0.1:51576
I20260502 20:01:11.866384 12914 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51576:
name: "default.Table_e36b131ff7344eba80b753a6b7ff4c11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:01:11.866779 12919 master_service.cc:954] ReplaceTablet: received request to replace tablet 0ea263d32fd2405985d4514c2ff02a39 from {username='slave'} at 127.0.0.1:51576
I20260502 20:01:11.867602 12915 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51576:
name: "default.Table_6b8d71e2af3a4d8ca933ba45c43b464e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:01:11.868083 12917 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51576:
name: "default.Table_8fe0445705b144e5adbda1bd0c71ba52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:01:11.868201 12922 master_service.cc:954] ReplaceTablet: received request to replace tablet af5837b307bb43258aa75c9a947dd5c6 from {username='slave'} at 127.0.0.1:51576
I20260502 20:01:11.868304 12918 master_service.cc:954] ReplaceTablet: received request to replace tablet 7d4b56bf7bac4ec7840e05107fd49caa from {username='slave'} at 127.0.0.1:51576
I20260502 20:01:11.868966 12916 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51576:
name: "default.Table_bcbf40331f9a4354927f24a56b69f1f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:01:11.869236 12913 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51576:
name: "default.Table_b19cf190454d42ff99d3fcab96f783b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:01:11.869473 12921 master_service.cc:954] ReplaceTablet: received request to replace tablet 5af60ba1c00442a798b20b2470f9216a from {username='slave'} at 127.0.0.1:51576
I20260502 20:01:11.871547 13067 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Refusing update from remote peer b470a66ad54f46b1b44a80dd1edf214e: Log matching property violated. Preceding OpId in replica: term: 8 index: 136. Preceding OpId from leader: term: 9 index: 138. (index mismatch)
I20260502 20:01:11.872203 13097 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 137, Last known committed idx: 136, Time since last communication: 0.000s
W20260502 20:01:11.873939 12907 consensus_peers.cc:597] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e -> Peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Couldn't send request to peer 38315e4f56484666b5e54afad02498ec. Status: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260502 20:01:11.876389 13104 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b470a66ad54f46b1b44a80dd1edf214e. Latest consensus state: current_term: 9 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:11.876538 13104 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
F20260502 20:01:11.877015 12975 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 26, previous 26; dumping first 3 out of 13 received events: NotificationEvent(eventId=25, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_b19cf190454d42ff99d3fcab96f783b1, message={"server":"","servicePrincipal":"","db":"default","table":"table_b19cf190454d42ff99d3fcab96f783b1","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_b19cf190454d42ff99d3fcab96f783b1\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752048},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b19cf190454d42ff99d3fcab96f783b1\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b19cf190454d42ff99d3fcab96f783b1\",\"kudu.table_id\":\"33b0206efcd84429a0b2bc366a81e1fb\",\"transient_lastDdlTime\":\"1777752048\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=ALTER_TABLE, dbName=default, tableName=table_b9b31b57bb724b299b6000678ee9e5a4, message={"server":"","servicePrincipal":"","db":"default","table":"table_24faf39307584530a038ed30536bd4c2","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_24faf39307584530a038ed30536bd4c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_24faf39307584530a038ed30536bd4c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_24faf39307584530a038ed30536bd4c2\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_b9b31b57bb724b299b6000678ee9e5a4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b9b31b57bb724b299b6000678ee9e5a4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b9b31b57bb724b299b6000678ee9e5a4\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1777752049}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_8ad450efb0df42d2bb35c3f8d3e0b78e, message={"server":"","servicePrincipal":"","db":"default","table":"table_8ad450efb0df42d2bb35c3f8d3e0b78e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752049},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_8ad450efb0df42d2bb35c3f8d3e0b78e\",\"kudu.table_id\":\"7d9fa0bb8a9b4877b6bbbac853119f8d\",\"transient_lastDdlTime\":\"1777752049\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7efe54282dcd google::LogMessage::Fail() at ??:0
@ 0x7efe54286b93 google::LogMessage::SendToLog() at ??:0
I20260502 20:01:11.884374 13128 mvcc.cc:204] Tried to move back new op lower bound from 7281672486387798016 to 7281672486044127232. Current Snapshot: MvccSnapshot[applied={T|T < 7281672486378467328}]
I20260502 20:01:11.884599 12922 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet af5837b307bb43258aa75c9a947dd5c6
@ 0x7efe542827cc google::LogMessage::Flush() at ??:0
I20260502 20:01:11.885414 13097 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 9 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:11.885540 13097 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: LEADER
I20260502 20:01:11.885951 12922 catalog_manager.cc:6741] ReplaceTablet: tablet af5837b307bb43258aa75c9a947dd5c6 deleted and replaced by tablet 88b24a1f26f348d7916feb0a96718691
I20260502 20:01:11.886080 12920 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet 26352d15574149da915d302b3a322a46
I20260502 20:01:11.886327 12922 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51576:
name: "default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:01:11.887079 13104 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "b470a66ad54f46b1b44a80dd1edf214e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:11.887228 13104 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7efe54282a11 google::LogMessage::~LogMessage() at ??:0
I20260502 20:01:11.890364 12918 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:01:11.886332 12920 catalog_manager.cc:6741] ReplaceTablet: tablet 26352d15574149da915d302b3a322a46 deleted and replaced by tablet 99eb1043f0b647f0b97b2ee5a3470661
I20260502 20:01:11.890683 12918 catalog_manager.cc:6741] ReplaceTablet: tablet 7d4b56bf7bac4ec7840e05107fd49caa deleted and replaced by tablet 72a2a8e20076465ba5e7ae6f7b99bba4
I20260502 20:01:11.890990 12918 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51576:
table { table_name: "default.Table_41826ad67ed540e0a427cd0347407518" } modify_external_catalogs: true
I20260502 20:01:11.891139 12918 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51576:
table { table_name: "default.Table_41826ad67ed540e0a427cd0347407518" } modify_external_catalogs: true
I20260502 20:01:11.891583 12920 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51576:
table { table_name: "default.Table_35a03681af3042babb0e601163d9fe20" } modify_external_catalogs: true
I20260502 20:01:11.891692 12920 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51576:
table { table_name: "default.Table_35a03681af3042babb0e601163d9fe20" } modify_external_catalogs: true
I20260502 20:01:11.893937 12919 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:01:11.894255 12919 catalog_manager.cc:6741] ReplaceTablet: tablet 0ea263d32fd2405985d4514c2ff02a39 deleted and replaced by tablet f18c3f56825043ac8dd4dedee165b317
I20260502 20:01:11.894452 12919 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51576:
table { table_name: "default.Table_8f233da2ffa04623bc614dc8d7d8e51c" } modify_external_catalogs: true
I20260502 20:01:11.894572 12919 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51576:
table { table_name: "default.Table_8f233da2ffa04623bc614dc8d7d8e51c" } modify_external_catalogs: true
I20260502 20:01:11.895910 12921 catalog_manager.cc:5958] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Sending DeleteTablet for 3 replicas of tablet 5af60ba1c00442a798b20b2470f9216a
I20260502 20:01:11.896206 12921 catalog_manager.cc:6741] ReplaceTablet: tablet 5af60ba1c00442a798b20b2470f9216a deleted and replaced by tablet e277a4429a8b408793f1bd55033e86c2
I20260502 20:01:11.896436 12921 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51576:
name: "default.Table_89091fe7dff644288a504e28216d5d69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7efe597f6433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 20:01:11.902352 11106 tablet_service.cc:1558] Processing DeleteTablet for tablet af5837b307bb43258aa75c9a947dd5c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 88b24a1f26f348d7916feb0a96718691) from {username='slave'} at 127.0.0.1:51068
I20260502 20:01:11.902572 11109 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d4b56bf7bac4ec7840e05107fd49caa with delete_type TABLET_DATA_DELETED (replaced by tablet 72a2a8e20076465ba5e7ae6f7b99bba4) from {username='slave'} at 127.0.0.1:51068
I20260502 20:01:11.902647 11112 tablet_service.cc:1558] Processing DeleteTablet for tablet 26352d15574149da915d302b3a322a46 with delete_type TABLET_DATA_DELETED (replaced by tablet 99eb1043f0b647f0b97b2ee5a3470661) from {username='slave'} at 127.0.0.1:51068
I20260502 20:01:11.902693 11111 tablet_service.cc:1558] Processing DeleteTablet for tablet 5af60ba1c00442a798b20b2470f9216a with delete_type TABLET_DATA_DELETED (replaced by tablet e277a4429a8b408793f1bd55033e86c2) from {username='slave'} at 127.0.0.1:51068
I20260502 20:01:11.902740 11110 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ea263d32fd2405985d4514c2ff02a39 with delete_type TABLET_DATA_DELETED (replaced by tablet f18c3f56825043ac8dd4dedee165b317) from {username='slave'} at 127.0.0.1:51068
@ 0x7efe597f534a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 20:01:11.907892 10976 tablet_service.cc:1558] Processing DeleteTablet for tablet af5837b307bb43258aa75c9a947dd5c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 88b24a1f26f348d7916feb0a96718691) from {username='slave'} at 127.0.0.1:38840
@ 0x7efe597f4aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 20:01:11.908401 10973 tablet_service.cc:1558] Processing DeleteTablet for tablet 26352d15574149da915d302b3a322a46 with delete_type TABLET_DATA_DELETED (replaced by tablet 99eb1043f0b647f0b97b2ee5a3470661) from {username='slave'} at 127.0.0.1:38840
I20260502 20:01:11.908540 10975 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d4b56bf7bac4ec7840e05107fd49caa with delete_type TABLET_DATA_DELETED (replaced by tablet 72a2a8e20076465ba5e7ae6f7b99bba4) from {username='slave'} at 127.0.0.1:38840
I20260502 20:01:11.908645 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ea263d32fd2405985d4514c2ff02a39 with delete_type TABLET_DATA_DELETED (replaced by tablet f18c3f56825043ac8dd4dedee165b317) from {username='slave'} at 127.0.0.1:38840
I20260502 20:01:11.908742 10972 tablet_service.cc:1558] Processing DeleteTablet for tablet 5af60ba1c00442a798b20b2470f9216a with delete_type TABLET_DATA_DELETED (replaced by tablet e277a4429a8b408793f1bd55033e86c2) from {username='slave'} at 127.0.0.1:38840
I20260502 20:01:11.908998 11110 tablet_service.cc:1511] Processing CreateTablet for tablet 88b24a1f26f348d7916feb0a96718691 (DEFAULT_TABLE table=default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:11.909343 11110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b24a1f26f348d7916feb0a96718691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:11.909718 11111 tablet_service.cc:1511] Processing CreateTablet for tablet 99eb1043f0b647f0b97b2ee5a3470661 (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:11.909919 11111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99eb1043f0b647f0b97b2ee5a3470661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:11.910179 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 88b24a1f26f348d7916feb0a96718691 (DEFAULT_TABLE table=default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:11.910470 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b24a1f26f348d7916feb0a96718691. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7efe597fa1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x560b8dd75244 std::function<>::operator()() at ??:0
I20260502 20:01:11.916402 13148 tablet_bootstrap.cc:492] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:01:11.916751 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 99eb1043f0b647f0b97b2ee5a3470661 (DEFAULT_TABLE table=default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:11.917178 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99eb1043f0b647f0b97b2ee5a3470661. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7efe557877ea kudu::Thread::SuperviseThread() at ??:0
I20260502 20:01:11.918502 13146 tablet_replica.cc:333] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:11.918648 13146 raft_consensus.cc:2243] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:01:11.920137 13148 tablet_bootstrap.cc:654] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:11.918850 13146 raft_consensus.cc:2272] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x7efe560cb6db start_thread at ??:0
I20260502 20:01:11.921204 13146 ts_tablet_manager.cc:1916] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:11.922111 13149 tablet_bootstrap.cc:492] T 88b24a1f26f348d7916feb0a96718691 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:01:11.923144 13149 tablet_bootstrap.cc:654] T 88b24a1f26f348d7916feb0a96718691 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
@ 0x7efe5343961f clone at ??:0
I20260502 20:01:11.925041 13145 tablet_replica.cc:333] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:11.925217 13145 raft_consensus.cc:2243] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:11.925354 13145 raft_consensus.cc:2272] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:11.925817 13145 ts_tablet_manager.cc:1916] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:11.927146 13148 tablet_bootstrap.cc:492] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:01:11.927233 13148 ts_tablet_manager.cc:1403] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260502 20:01:11.927728 13148 raft_consensus.cc:359] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:11.927835 13148 raft_consensus.cc:385] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:11.927866 13148 raft_consensus.cc:740] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:01:11.928007 13148 consensus_queue.cc:260] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:11.928290 13148 ts_tablet_manager.cc:1434] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:01:11.928390 13145 ts_tablet_manager.cc:1929] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:11.928467 13145 log.cc:1199] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/af5837b307bb43258aa75c9a947dd5c6
I20260502 20:01:11.928730 13145 ts_tablet_manager.cc:1950] T af5837b307bb43258aa75c9a947dd5c6 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:11.929008 13146 ts_tablet_manager.cc:1929] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:11.929086 13146 log.cc:1199] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/af5837b307bb43258aa75c9a947dd5c6
I20260502 20:01:11.929368 13146 ts_tablet_manager.cc:1950] T af5837b307bb43258aa75c9a947dd5c6 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:11.929785 13148 tablet_bootstrap.cc:492] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:01:11.930042 13146 tablet_replica.cc:333] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:11.930176 13146 raft_consensus.cc:2243] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:11.930277 13146 raft_consensus.cc:2272] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:11.930505 13057 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" instance_seqno: 1777752043728997) as {username='slave'} at 127.10.27.130:49267; Asking this server to re-register.
I20260502 20:01:11.930653 13146 ts_tablet_manager.cc:1916] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:11.930826 13148 tablet_bootstrap.cc:654] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:11.931488 11180 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:11.932546 13057 ts_manager.cc:194] Registered new tserver with Master: b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:11.934047 13146 ts_tablet_manager.cc:1929] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:11.934118 13146 log.cc:1199] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/26352d15574149da915d302b3a322a46
I20260502 20:01:11.934382 13146 ts_tablet_manager.cc:1950] T 26352d15574149da915d302b3a322a46 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:11.935154 13146 tablet_replica.cc:333] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:11.935276 13146 raft_consensus.cc:2243] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:01:11.935469 13146 raft_consensus.cc:2272] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:11.935570 13145 tablet_replica.cc:333] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:11.935693 13145 raft_consensus.cc:2243] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:11.935803 13145 raft_consensus.cc:2272] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:11.935889 13146 ts_tablet_manager.cc:1916] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:11.936177 13145 ts_tablet_manager.cc:1916] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:11.938071 13146 ts_tablet_manager.cc:1929] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:11.938154 13146 log.cc:1199] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:01:11.938423 13146 ts_tablet_manager.cc:1950] T 7d4b56bf7bac4ec7840e05107fd49caa P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:11.939198 13149 tablet_bootstrap.cc:492] T 88b24a1f26f348d7916feb0a96718691 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:01:11.939286 13149 ts_tablet_manager.cc:1403] T 88b24a1f26f348d7916feb0a96718691 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20260502 20:01:11.939651 13145 ts_tablet_manager.cc:1929] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:11.939719 13145 log.cc:1199] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:01:11.939769 13149 raft_consensus.cc:359] T 88b24a1f26f348d7916feb0a96718691 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:11.939873 13149 raft_consensus.cc:385] T 88b24a1f26f348d7916feb0a96718691 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:11.939903 13149 raft_consensus.cc:740] T 88b24a1f26f348d7916feb0a96718691 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:01:11.939967 13145 ts_tablet_manager.cc:1950] T 7d4b56bf7bac4ec7840e05107fd49caa P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:11.940048 13149 consensus_queue.cc:260] T 88b24a1f26f348d7916feb0a96718691 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:11.940359 11043 heartbeater.cc:499] Master 127.10.27.188:33369 was elected leader, sending a full tablet report...
I20260502 20:01:11.940404 13149 ts_tablet_manager.cc:1434] T 88b24a1f26f348d7916feb0a96718691 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:01:11.941814 13149 tablet_bootstrap.cc:492] T 99eb1043f0b647f0b97b2ee5a3470661 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:01:11.942871 13149 tablet_bootstrap.cc:654] T 99eb1043f0b647f0b97b2ee5a3470661 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:11.944489 13145 tablet_replica.cc:333] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:11.944639 13145 raft_consensus.cc:2243] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:01:11.944866 13145 raft_consensus.cc:2272] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:11.945298 13145 ts_tablet_manager.cc:1916] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:11.947397 13146 tablet_replica.cc:333] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:11.947530 13146 raft_consensus.cc:2243] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:01:11.947733 13146 raft_consensus.cc:2272] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:11.948089 13146 ts_tablet_manager.cc:1916] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:11.949430 13148 tablet_bootstrap.cc:492] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:01:11.949535 13148 ts_tablet_manager.cc:1403] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20260502 20:01:11.950037 13148 raft_consensus.cc:359] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } }
I20260502 20:01:11.950143 13148 raft_consensus.cc:385] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:11.950172 13148 raft_consensus.cc:740] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:01:11.950318 13146 ts_tablet_manager.cc:1929] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:01:11.950304 13148 consensus_queue.cc:260] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } }
I20260502 20:01:11.950384 13146 log.cc:1199] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/0ea263d32fd2405985d4514c2ff02a39
I20260502 20:01:11.950577 13148 ts_tablet_manager.cc:1434] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:01:11.950621 13146 ts_tablet_manager.cc:1950] T 0ea263d32fd2405985d4514c2ff02a39 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:11.951321 13149 tablet_bootstrap.cc:492] T 99eb1043f0b647f0b97b2ee5a3470661 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:01:11.951398 13149 ts_tablet_manager.cc:1403] T 99eb1043f0b647f0b97b2ee5a3470661 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20260502 20:01:11.951915 13149 raft_consensus.cc:359] T 99eb1043f0b647f0b97b2ee5a3470661 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } }
I20260502 20:01:11.952021 13149 raft_consensus.cc:385] T 99eb1043f0b647f0b97b2ee5a3470661 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:11.952054 13149 raft_consensus.cc:740] T 99eb1043f0b647f0b97b2ee5a3470661 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:01:11.952186 13149 consensus_queue.cc:260] T 99eb1043f0b647f0b97b2ee5a3470661 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } }
I20260502 20:01:11.952466 13149 ts_tablet_manager.cc:1434] T 99eb1043f0b647f0b97b2ee5a3470661 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:01:11.953641 13146 tablet_replica.cc:333] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:11.953758 13146 raft_consensus.cc:2243] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:01:11.953934 13146 raft_consensus.cc:2272] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:11.954327 13146 ts_tablet_manager.cc:1916] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:11.956586 13146 ts_tablet_manager.cc:1929] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:11.956655 13146 log.cc:1199] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/5af60ba1c00442a798b20b2470f9216a
I20260502 20:01:11.956913 13146 ts_tablet_manager.cc:1950] T 5af60ba1c00442a798b20b2470f9216a P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:11.960273 13145 ts_tablet_manager.cc:1929] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:11.960350 13145 log.cc:1199] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/26352d15574149da915d302b3a322a46
I20260502 20:01:11.960592 13145 ts_tablet_manager.cc:1950] T 26352d15574149da915d302b3a322a46 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:11.961239 13145 tablet_replica.cc:333] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:11.961364 13145 raft_consensus.cc:2243] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:11.961455 13145 raft_consensus.cc:2272] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:11.961793 13145 ts_tablet_manager.cc:1916] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:11.964635 13145 ts_tablet_manager.cc:1929] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:11.964706 13145 log.cc:1199] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/5af60ba1c00442a798b20b2470f9216a
I20260502 20:01:11.965055 13145 ts_tablet_manager.cc:1950] T 5af60ba1c00442a798b20b2470f9216a P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:11.965986 13145 tablet_replica.cc:333] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:11.966110 13145 raft_consensus.cc:2243] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:11.966250 13145 raft_consensus.cc:2272] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:11.966614 13145 ts_tablet_manager.cc:1916] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:11.968554 13145 ts_tablet_manager.cc:1929] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 20:01:11.968613 13145 log.cc:1199] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/0ea263d32fd2405985d4514c2ff02a39
I20260502 20:01:11.968842 13145 ts_tablet_manager.cc:1950] T 0ea263d32fd2405985d4514c2ff02a39 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:12.057085 13147 raft_consensus.cc:493] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:12.057268 13147 raft_consensus.cc:515] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } }
I20260502 20:01:12.057788 13147 leader_election.cc:290] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:01:12.059350 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb1043f0b647f0b97b2ee5a3470661" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:01:12.059531 10982 raft_consensus.cc:2468] T 99eb1043f0b647f0b97b2ee5a3470661 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
W20260502 20:01:12.059752 11065 leader_election.cc:343] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Not found: Tablet not found: 99eb1043f0b647f0b97b2ee5a3470661
I20260502 20:01:12.059921 11065 leader_election.cc:304] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters: ade741c4062940adb2223b55187ffe72
I20260502 20:01:12.060165 13147 raft_consensus.cc:2804] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:01:12.060240 13147 raft_consensus.cc:493] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:01:12.060282 13147 raft_consensus.cc:3060] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:12.061487 13147 raft_consensus.cc:515] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } }
I20260502 20:01:12.061932 13147 leader_election.cc:290] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:01:12.062610 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99eb1043f0b647f0b97b2ee5a3470661" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
W20260502 20:01:12.062675 11065 leader_election.cc:343] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Not found: Tablet not found: 99eb1043f0b647f0b97b2ee5a3470661
I20260502 20:01:12.062760 10982 raft_consensus.cc:3060] T 99eb1043f0b647f0b97b2ee5a3470661 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:12.063825 10982 raft_consensus.cc:2468] T 99eb1043f0b647f0b97b2ee5a3470661 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:01:12.064193 11065 leader_election.cc:304] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters: ade741c4062940adb2223b55187ffe72
I20260502 20:01:12.064380 13147 raft_consensus.cc:2804] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:01:12.064504 13147 raft_consensus.cc:697] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:01:12.064652 13147 consensus_queue.cc:237] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } }
I20260502 20:01:12.107934 11321 heartbeater.cc:344] Connected to a master server at 127.10.27.189:46281
I20260502 20:01:12.109251 13057 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ade741c4062940adb2223b55187ffe72" instance_seqno: 1777752043938024) as {username='slave'} at 127.10.27.131:46661; Asking this server to re-register.
I20260502 20:01:12.109711 11321 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:12.110692 13057 ts_manager.cc:194] Registered new tserver with Master: ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
W20260502 20:01:12.119699 10931 connection.cc:570] server connection from 127.0.0.1:38840 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:12.119730 11068 connection.cc:570] server connection from 127.0.0.1:51068 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:12.119999 13141 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 20:01:11.891131 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:53444 (local address 127.10.27.131:43389)
0502 20:01:11.896985 (+ 5854us) server_negotiation.cc:207] Beginning negotiation
0502 20:01:11.896991 (+ 6us) server_negotiation.cc:400] Waiting for connection header
0502 20:01:11.897011 (+ 20us) server_negotiation.cc:408] Connection header received
0502 20:01:11.897068 (+ 57us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0502 20:01:11.897071 (+ 3us) server_negotiation.cc:462] Received NEGOTIATE request from client
0502 20:01:11.897137 (+ 66us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0502 20:01:11.897260 (+ 123us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0502 20:01:11.902819 (+ 5559us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0502 20:01:11.924484 (+ 21665us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0502 20:01:12.119821 (+195337us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53444: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":5744,"thread_start_us":92,"threads_started":1}
W20260502 20:01:12.119995 11067 connection.cc:570] client connection to 127.10.27.188:33369 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:12.120014 10932 connection.cc:570] client connection to 127.10.27.188:33369 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:12.120607 11208 connection.cc:570] client connection to 127.10.27.188:33369 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:12.120905 11328 connection.cc:570] client connection to 127.10.27.188:33369 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:12.121417 11328 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.10.27.188:33369)
W20260502 20:01:12.121747 11328 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.10.27.188:33369)
W20260502 20:01:12.121840 11328 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.27.188:33369)
W20260502 20:01:12.121934 11328 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.10.27.188:33369)
W20260502 20:01:12.122830 13101 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 20:01:12.120661 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.10.27.188:33369 (local address 127.10.27.130:59413)
0502 20:01:12.121020 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0502 20:01:12.121035 (+ 15us) client_negotiation.cc:175] Beginning negotiation
0502 20:01:12.121123 (+ 88us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 20:01:12.122707 (+ 1584us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":264}
W20260502 20:01:12.123371 13126 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 20:01:12.120757 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.10.27.188:33369 (local address 127.10.27.129:36329)
0502 20:01:12.120974 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0502 20:01:12.120991 (+ 17us) client_negotiation.cc:175] Beginning negotiation
0502 20:01:12.121106 (+ 115us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 20:01:12.123276 (+ 2170us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":126}
I20260502 20:01:12.201229 13147 raft_consensus.cc:493] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:12.201383 13147 raft_consensus.cc:515] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:12.202071 13147 leader_election.cc:290] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:01:12.202735 11065 leader_election.cc:343] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Not found: Tablet not found: 88b24a1f26f348d7916feb0a96718691
I20260502 20:01:12.202749 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b24a1f26f348d7916feb0a96718691" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:01:12.203038 10982 raft_consensus.cc:2468] T 88b24a1f26f348d7916feb0a96718691 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:01:12.203413 11065 leader_election.cc:304] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters: ade741c4062940adb2223b55187ffe72
I20260502 20:01:12.203603 13147 raft_consensus.cc:2804] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:01:12.203662 13147 raft_consensus.cc:493] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:01:12.203720 13147 raft_consensus.cc:3060] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:12.204663 13147 raft_consensus.cc:515] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:12.205049 13147 leader_election.cc:290] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:01:12.205449 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b24a1f26f348d7916feb0a96718691" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:01:12.205583 10982 raft_consensus.cc:3060] T 88b24a1f26f348d7916feb0a96718691 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
W20260502 20:01:12.205796 11065 leader_election.cc:343] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Not found: Tablet not found: 88b24a1f26f348d7916feb0a96718691
I20260502 20:01:12.206421 10982 raft_consensus.cc:2468] T 88b24a1f26f348d7916feb0a96718691 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:01:12.206873 11065 leader_election.cc:304] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters: ade741c4062940adb2223b55187ffe72
I20260502 20:01:12.207206 13147 raft_consensus.cc:2804] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:01:12.207336 13147 raft_consensus.cc:697] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:01:12.207499 13147 consensus_queue.cc:237] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:12.422302 13167 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:01:12.422442 13167 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:12.423892 13167 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:01:12.424558 13042 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:12.425450 13043 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
W20260502 20:01:12.425977 13042 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:12.426064 13042 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e
I20260502 20:01:12.426329 13167 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260502 20:01:12.499368 12997 consensus_queue.cc:1048] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 20:01:12.505750 11065 consensus_peers.cc:597] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1 -> Peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Couldn't send request to peer ade741c4062940adb2223b55187ffe72. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99eb1043f0b647f0b97b2ee5a3470661. This is attempt 1: this message will repeat every 5th retry.
W20260502 20:01:12.623214 11065 consensus_peers.cc:597] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 -> Peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Couldn't send request to peer ade741c4062940adb2223b55187ffe72. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88b24a1f26f348d7916feb0a96718691. This is attempt 1: this message will repeat every 5th retry.
I20260502 20:01:12.780395 12997 consensus_queue.cc:1048] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:01:12.827919 12820 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:12.828074 12820 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:12.828615 12820 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:12.829655 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:01:12.829800 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:01:12.830062 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:12.830339 12820 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:12.925942 13176 ts_tablet_manager.cc:933] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72: Initiating tablet copy from peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:12.926749 13176 tablet_copy_client.cc:323] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72: tablet copy: Beginning tablet copy session from remote peer at address 127.10.27.130:43285
I20260502 20:01:12.927620 11152 tablet_copy_service.cc:140] P b85d150f168f406bb31ff44150b2b1a1: Received BeginTabletCopySession request for tablet 99eb1043f0b647f0b97b2ee5a3470661 from peer ade741c4062940adb2223b55187ffe72 ({username='slave'} at 127.10.27.131:59643)
I20260502 20:01:12.927774 11152 tablet_copy_service.cc:161] P b85d150f168f406bb31ff44150b2b1a1: Beginning new tablet copy session on tablet 99eb1043f0b647f0b97b2ee5a3470661 from peer ade741c4062940adb2223b55187ffe72 at {username='slave'} at 127.10.27.131:59643: session id = ade741c4062940adb2223b55187ffe72-99eb1043f0b647f0b97b2ee5a3470661
I20260502 20:01:12.929029 11152 tablet_copy_source_session.cc:215] T 99eb1043f0b647f0b97b2ee5a3470661 P b85d150f168f406bb31ff44150b2b1a1: Tablet Copy: opened 0 blocks and 1 log segments
I20260502 20:01:12.930595 13176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99eb1043f0b647f0b97b2ee5a3470661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:12.932747 13176 tablet_copy_client.cc:806] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72: tablet copy: Starting download of 0 data blocks...
I20260502 20:01:12.932979 13176 tablet_copy_client.cc:670] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72: tablet copy: Starting download of 1 WAL segments...
I20260502 20:01:12.935134 13176 tablet_copy_client.cc:538] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260502 20:01:12.936724 13176 tablet_bootstrap.cc:492] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:01:12.940783 13176 tablet_bootstrap.cc:492] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:01:12.941128 13176 tablet_bootstrap.cc:492] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72: Bootstrap complete.
I20260502 20:01:12.941337 13176 ts_tablet_manager.cc:1403] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260502 20:01:12.941841 13176 raft_consensus.cc:359] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } }
I20260502 20:01:12.941949 13176 raft_consensus.cc:740] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:01:12.942101 13176 consensus_queue.cc:260] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } }
I20260502 20:01:12.942389 13176 ts_tablet_manager.cc:1434] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:01:12.943472 11152 tablet_copy_service.cc:342] P b85d150f168f406bb31ff44150b2b1a1: Request end of tablet copy session ade741c4062940adb2223b55187ffe72-99eb1043f0b647f0b97b2ee5a3470661 received from {username='slave'} at 127.10.27.131:59643
I20260502 20:01:12.943591 11152 tablet_copy_service.cc:434] P b85d150f168f406bb31ff44150b2b1a1: ending tablet copy session ade741c4062940adb2223b55187ffe72-99eb1043f0b647f0b97b2ee5a3470661 on tablet 99eb1043f0b647f0b97b2ee5a3470661 with peer ade741c4062940adb2223b55187ffe72
I20260502 20:01:13.065460 13180 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:01:13.065598 13180 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:13.066205 13180 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:01:13.067556 13042 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:13.067692 13043 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
I20260502 20:01:13.067786 13043 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e
I20260502 20:01:13.067950 13180 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260502 20:01:13.080631 12820 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:13.080801 12820 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:13.081331 12820 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:13.082042 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:01:13.082132 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:01:13.082221 11206 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:13.082356 12820 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:13.164433 13176 ts_tablet_manager.cc:933] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72: Initiating tablet copy from peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:13.164767 13176 tablet_copy_client.cc:323] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72: tablet copy: Beginning tablet copy session from remote peer at address 127.10.27.130:43285
I20260502 20:01:13.165441 11152 tablet_copy_service.cc:140] P b85d150f168f406bb31ff44150b2b1a1: Received BeginTabletCopySession request for tablet 88b24a1f26f348d7916feb0a96718691 from peer ade741c4062940adb2223b55187ffe72 ({username='slave'} at 127.10.27.131:59643)
I20260502 20:01:13.165551 11152 tablet_copy_service.cc:161] P b85d150f168f406bb31ff44150b2b1a1: Beginning new tablet copy session on tablet 88b24a1f26f348d7916feb0a96718691 from peer ade741c4062940adb2223b55187ffe72 at {username='slave'} at 127.10.27.131:59643: session id = ade741c4062940adb2223b55187ffe72-88b24a1f26f348d7916feb0a96718691
I20260502 20:01:13.166307 11152 tablet_copy_source_session.cc:215] T 88b24a1f26f348d7916feb0a96718691 P b85d150f168f406bb31ff44150b2b1a1: Tablet Copy: opened 0 blocks and 1 log segments
I20260502 20:01:13.167256 13176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b24a1f26f348d7916feb0a96718691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:13.169039 13176 tablet_copy_client.cc:806] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72: tablet copy: Starting download of 0 data blocks...
I20260502 20:01:13.169163 13176 tablet_copy_client.cc:670] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72: tablet copy: Starting download of 1 WAL segments...
I20260502 20:01:13.170405 13176 tablet_copy_client.cc:538] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260502 20:01:13.171645 13176 tablet_bootstrap.cc:492] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:01:13.174863 13176 tablet_bootstrap.cc:492] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:01:13.175237 13176 tablet_bootstrap.cc:492] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72: Bootstrap complete.
I20260502 20:01:13.175428 13176 ts_tablet_manager.cc:1403] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.001s
I20260502 20:01:13.175891 13176 raft_consensus.cc:359] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:13.176033 13176 raft_consensus.cc:740] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:01:13.176208 13176 consensus_queue.cc:260] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:13.176507 13176 ts_tablet_manager.cc:1434] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:01:13.177230 11152 tablet_copy_service.cc:342] P b85d150f168f406bb31ff44150b2b1a1: Request end of tablet copy session ade741c4062940adb2223b55187ffe72-88b24a1f26f348d7916feb0a96718691 received from {username='slave'} at 127.10.27.131:59643
I20260502 20:01:13.177325 11152 tablet_copy_service.cc:434] P b85d150f168f406bb31ff44150b2b1a1: ending tablet copy session ade741c4062940adb2223b55187ffe72-88b24a1f26f348d7916feb0a96718691 on tablet 88b24a1f26f348d7916feb0a96718691 with peer ade741c4062940adb2223b55187ffe72
I20260502 20:01:13.321785 12820 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:13.321934 12820 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:13.322566 12820 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:01:13.323581 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:01:13.323719 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:01:13.323791 11209 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:13.323966 12820 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:13.341104 12820 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:13.341254 12820 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:13.341745 12820 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:13.342522 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:01:13.342610 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:01:13.342697 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:13.342835 12820 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:13.406407 12820 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:13.406574 12820 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:13.407193 12820 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:13.408052 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:01:13.408145 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:01:13.408239 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:13.408389 12820 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:13.529728 11272 raft_consensus.cc:1217] T 99eb1043f0b647f0b97b2ee5a3470661 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260502 20:01:13.771711 11272 raft_consensus.cc:1217] T 88b24a1f26f348d7916feb0a96718691 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260502 20:01:13.868462 13194 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:01:13.868605 13194 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:13.869135 13194 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
W20260502 20:01:13.870597 13043 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369): Network error: Client connection negotiation failed: client connection to 127.10.27.188:33369: connect: Connection refused (error 111)
W20260502 20:01:13.870774 13042 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:13.870857 13042 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec, b470a66ad54f46b1b44a80dd1edf214e
I20260502 20:01:13.871062 13194 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260502 20:01:14.838037 13205 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:14.838177 13205 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:14.838646 13205 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:14.839563 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:01:14.839679 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:01:14.839740 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:14.839890 13205 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:14.891963 10350 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
/tmp/dist-test-taskpeoj1k/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.188:33369
--webserver_interface=127.10.27.188
--webserver_port=35669
--builtin_ntp_servers=127.10.27.148:34849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260502 20:01:14.931144 13205 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:14.931336 13205 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:14.932040 13205 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:14.932860 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:01:14.932996 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:01:14.933108 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:14.933262 13205 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:14.950233 13205 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:14.950489 13205 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:14.951027 13205 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:14.951802 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:01:14.951941 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:01:14.952114 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:14.952456 13205 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:15.007962 13211 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 20:01:15.008234 13211 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 20:01:15.008319 13211 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 20:01:15.012055 13211 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 20:01:15.012156 13211 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 20:01:15.012192 13211 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 20:01:15.012233 13211 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 20:01:15.016981 13211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.27.148:34849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:34803
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.27.188:33369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.27.188
--webserver_port=35669
--never_fsync=true
--heap_profile_path=/tmp/kudu.13211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 19:43:16 UTC on bdcb31816ec0
build id 11712
I20260502 20:01:15.018200 13211 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 20:01:15.019426 13211 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 20:01:15.025339 13217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:01:15.025301 13216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 20:01:15.025329 13219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 20:01:15.025699 13211 server_base.cc:1061] running on GCE node
I20260502 20:01:15.026278 13211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 20:01:15.027568 13211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 20:01:15.028788 13211 hybrid_clock.cc:648] HybridClock initialized: now 1777752075028742 us; error 72 us; skew 500 ppm
I20260502 20:01:15.031221 13211 webserver.cc:492] Webserver started at http://127.10.27.188:35669/ using document root <none> and password file <none>
I20260502 20:01:15.031884 13211 fs_manager.cc:362] Metadata directory not provided
I20260502 20:01:15.031981 13211 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 20:01:15.035661 13211 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260502 20:01:15.038437 13225 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 20:01:15.039654 13211 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260502 20:01:15.039790 13211 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data,/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
uuid: "b470a66ad54f46b1b44a80dd1edf214e"
format_stamp: "Formatted at 2026-05-02 20:00:42 on dist-test-slave-0dwf"
I20260502 20:01:15.040252 13211 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 20:01:15.067178 13211 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 20:01:15.067916 13211 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 20:01:15.068145 13211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 20:01:15.078070 13211 rpc_server.cc:307] RPC server started. Bound to: 127.10.27.188:33369
I20260502 20:01:15.078060 13277 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.27.188:33369 every 8 connection(s)
I20260502 20:01:15.079385 13211 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/master-2/data/info.pb
I20260502 20:01:15.083665 13278 sys_catalog.cc:263] Verifying existing consensus state
I20260502 20:01:15.085315 13278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Bootstrap starting.
I20260502 20:01:15.089422 10350 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskpeoj1k/build/debug/bin/kudu as pid 13211
I20260502 20:01:15.101135 13278 log.cc:826] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Log is configured to *not* fsync() on all Append() calls
I20260502 20:01:15.187538 13283 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:01:15.187670 13283 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:15.188220 13283 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
I20260502 20:01:15.189239 13278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Bootstrap replayed 1/1 log segments. Stats: ops{read=144 overwritten=0 applied=144 ignored=0} inserts{seen=86 ignored=0} mutations{seen=135 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260502 20:01:15.189604 13042 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:15.189700 13278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: Bootstrap complete.
I20260502 20:01:15.189919 13205 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:15.190054 13205 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:15.190518 13205 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:15.191437 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:01:15.191655 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:01:15.191759 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:15.192004 13205 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:15.193732 13278 raft_consensus.cc:359] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 9 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:15.194365 13278 raft_consensus.cc:740] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 9 FOLLOWER]: Becoming Follower/Learner. State: Replica: b470a66ad54f46b1b44a80dd1edf214e, State: Initialized, Role: FOLLOWER
I20260502 20:01:15.195026 13278 consensus_queue.cc:260] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 144, Last appended: 9.144, Last appended by leader: 144, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:15.195617 13287 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:15.195755 13287 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:01:15.196502 13278 sys_catalog.cc:565] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: configured and running, proceeding with master startup.
I20260502 20:01:15.196529 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ef9294b460014382a2a594c77f8900d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 144 } } ignore_live_leader: false dest_uuid: "b470a66ad54f46b1b44a80dd1edf214e" is_pre_election: true
I20260502 20:01:15.196785 13252 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef9294b460014382a2a594c77f8900d4 in term 9.
I20260502 20:01:15.197407 13043 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec
I20260502 20:01:15.197650 13283 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260502 20:01:15.197728 13283 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b470a66ad54f46b1b44a80dd1edf214e)
I20260502 20:01:15.197786 13283 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 9 FOLLOWER]: Advancing to term 10
I20260502 20:01:15.198812 13283 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:15.199327 13283 leader_election.cc:290] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 election: Requested vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), b470a66ad54f46b1b44a80dd1edf214e (127.10.27.188:33369)
I20260502 20:01:15.199790 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ef9294b460014382a2a594c77f8900d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 144 } } ignore_live_leader: false dest_uuid: "b470a66ad54f46b1b44a80dd1edf214e"
I20260502 20:01:15.199918 13252 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 9 FOLLOWER]: Advancing to term 10
W20260502 20:01:15.200412 13042 leader_election.cc:336] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:15.202200 13252 raft_consensus.cc:2468] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef9294b460014382a2a594c77f8900d4 in term 10.
I20260502 20:01:15.202760 13043 leader_election.cc:304] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e, ef9294b460014382a2a594c77f8900d4; no voters: 38315e4f56484666b5e54afad02498ec
I20260502 20:01:15.203049 13283 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260502 20:01:15.203277 13283 raft_consensus.cc:697] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [term 10 LEADER]: Becoming Leader. State: Replica: ef9294b460014382a2a594c77f8900d4, State: Running, Role: LEADER
I20260502 20:01:15.203588 13283 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 144, Committed index: 144, Last appended: 9.144, Last appended by leader: 144, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:15.202778 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:01:15.204743 13304 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef9294b460014382a2a594c77f8900d4. Latest consensus state: current_term: 10 leader_uuid: "ef9294b460014382a2a594c77f8900d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:15.204918 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:01:15.205027 13304 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: LEADER
I20260502 20:01:15.205412 13306 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 20:01:15.207830 13306 catalog_manager.cc:679] Loaded metadata for table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc]
I20260502 20:01:15.208256 13306 catalog_manager.cc:679] Loaded metadata for table default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02]
I20260502 20:01:15.208494 13306 catalog_manager.cc:679] Loaded metadata for table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464]
I20260502 20:01:15.208724 13306 catalog_manager.cc:679] Loaded metadata for table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b]
I20260502 20:01:15.208807 13301 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:01:15.208874 13301 catalog_manager.cc:1562] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: loading cluster ID for follower catalog manager: success
I20260502 20:01:15.208990 13306 catalog_manager.cc:679] Loaded metadata for table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064]
I20260502 20:01:15.209231 13306 catalog_manager.cc:679] Loaded metadata for table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]
I20260502 20:01:15.209472 13306 catalog_manager.cc:679] Loaded metadata for table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760]
I20260502 20:01:15.209695 13306 catalog_manager.cc:679] Loaded metadata for table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]
I20260502 20:01:15.209898 13306 catalog_manager.cc:679] Loaded metadata for table default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150]
I20260502 20:01:15.210335 13306 catalog_manager.cc:679] Loaded metadata for table default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]
I20260502 20:01:15.210562 13306 catalog_manager.cc:679] Loaded metadata for table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f]
I20260502 20:01:15.210772 13306 catalog_manager.cc:679] Loaded metadata for table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2]
I20260502 20:01:15.211027 13306 catalog_manager.cc:679] Loaded metadata for table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63]
I20260502 20:01:15.211275 13306 catalog_manager.cc:679] Loaded metadata for table default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b]
I20260502 20:01:15.211519 13306 catalog_manager.cc:679] Loaded metadata for table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86]
I20260502 20:01:15.212828 13301 catalog_manager.cc:1584] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: acquiring CA information for follower catalog manager: success
I20260502 20:01:15.213611 13306 tablet_loader.cc:96] loaded metadata for tablet 0fd6383acb6e4ebc832cfe39903108b9 (table default.table_d4efc4ecb8b04c828595edb245352971 [id=4ce433e96065488abd346ff7bb660464])
I20260502 20:01:15.213800 13306 tablet_loader.cc:96] loaded metadata for tablet 11548942c58f4c05bad32038a55b8f66 (table default.table_8f233da2ffa04623bc614dc8d7d8e51c [id=f0219fbc9a284d7db713f900ab2f2c63])
I20260502 20:01:15.214214 13306 tablet_loader.cc:96] loaded metadata for tablet 218dfac06cf841c6aced6781154f283a (table default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f])
I20260502 20:01:15.215078 13306 tablet_loader.cc:96] loaded metadata for tablet 3cdb6695c99e4da682e33b146b0e51ab (table default.table_e3ad181715724e36aa7276f9790d41bf [id=f769e13a80464a7983ad676c469e2e86])
I20260502 20:01:15.215092 13301 catalog_manager.cc:1612] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 20:01:15.215955 13306 tablet_loader.cc:96] loaded metadata for tablet 72a2a8e20076465ba5e7ae6f7b99bba4 (table default.table_972ed2d875504da381cc8d7d4a7630de [id=f1790d56aefb46c69a6fbb4522d0af3b])
I20260502 20:01:15.216423 13306 tablet_loader.cc:96] loaded metadata for tablet 88b24a1f26f348d7916feb0a96718691 (table default.table_54d68ed8aef94a978c1ad2a5e5312cab [id=536908a003d34b1997dce28d2c91327b])
I20260502 20:01:15.216785 13306 tablet_loader.cc:96] loaded metadata for tablet 99eb1043f0b647f0b97b2ee5a3470661 (table default.table_24faf39307584530a038ed30536bd4c2 [id=69692b57e81f408db409df6a8991a064])
I20260502 20:01:15.216886 13205 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:15.217006 13205 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.217247 13306 tablet_loader.cc:96] loaded metadata for tablet 9df3ebd756b248d0b92bad3259e7a122 (table default.table_fcdc343b9b214cd4ad8839e21ec7af0f [id=a43281e34df745e1a9295400ec974150])
I20260502 20:01:15.217549 13306 tablet_loader.cc:96] loaded metadata for tablet a18f3a9b1f514513a807d0a919db1f20 (table default.table_115178421c134252971c7a71b1134464 [id=7f99eb7719134a54a8f42be5b8c48760])
I20260502 20:01:15.217651 13205 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:01:15.218493 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:01:15.218693 13306 tablet_loader.cc:96] loaded metadata for tablet c3ab3bbc37b94d6f97081c8fd069749a (table default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b])
W20260502 20:01:15.218750 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:01:15.218827 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:15.219023 13205 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:15.219686 13306 tablet_loader.cc:96] loaded metadata for tablet e277a4429a8b408793f1bd55033e86c2 (table default.table_7d6b7fac1a1a41d680d0d2c5a9806f43 [id=4496e3f1cb2a4e2ea1b952e15cfaca02])
I20260502 20:01:15.219880 13306 tablet_loader.cc:96] loaded metadata for tablet e43e158d448442d3811dbdfe82db47ca (table default.table_41826ad67ed540e0a427cd0347407518 [id=e0c3a8a8b06e4796b9830f73219a09c2])
I20260502 20:01:15.220252 13306 tablet_loader.cc:96] loaded metadata for tablet f18c3f56825043ac8dd4dedee165b317 (table default.table_ac5362bfe46a4090a35bd51ad90c59ad [id=d6472edfe7e64aa8b3bdd9fd5e7ffc6f])
I20260502 20:01:15.220436 13306 tablet_loader.cc:96] loaded metadata for tablet f6de313115d04ebebe7c481d640c260e (table default.table_35a03681af3042babb0e601163d9fe20 [id=128b3728f94e46d1b4450c586944e3dc])
I20260502 20:01:15.220709 13306 tablet_loader.cc:96] loaded metadata for tablet faafd4c8dd3a4e2ebea018657480f840 (table default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee])
I20260502 20:01:15.220875 13306 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 20:01:15.221603 13306 catalog_manager.cc:1269] Loaded cluster ID: bef656f6f161410aa7c9b68cc234cedf
I20260502 20:01:15.221648 13306 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 20:01:15.222409 13306 catalog_manager.cc:1514] Loading token signing keys...
I20260502 20:01:15.223091 13306 catalog_manager.cc:6055] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Loaded TSK: 0
I20260502 20:01:15.223728 13306 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 20:01:15.224390 13306 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 20:01:15.224975 13306 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 24
I20260502 20:01:15.263059 13056 master_service.cc:954] ReplaceTablet: received request to replace tablet faafd4c8dd3a4e2ebea018657480f840 from {username='slave'} at 127.0.0.1:51896
I20260502 20:01:15.263743 13055 master_service.cc:954] ReplaceTablet: received request to replace tablet c3ab3bbc37b94d6f97081c8fd069749a from {username='slave'} at 127.0.0.1:51896
I20260502 20:01:15.264436 13057 master_service.cc:954] ReplaceTablet: received request to replace tablet 9df3ebd756b248d0b92bad3259e7a122 from {username='slave'} at 127.0.0.1:51896
I20260502 20:01:15.265040 13052 master_service.cc:954] ReplaceTablet: received request to replace tablet 3cdb6695c99e4da682e33b146b0e51ab from {username='slave'} at 127.0.0.1:51896
I20260502 20:01:15.265276 13051 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51896:
name: "default.Table_2eef3c375d5248539d96b67ea8bbc2be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:01:15.265504 13050 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51896:
table { table_name: "default.Table_0d8473dff6e244c199473f589d46be1b" } new_table_name: "default.Table_41eddb5da0424c5ea3a77e1f59af0916" modify_external_catalogs: true
I20260502 20:01:15.265658 13054 master_service.cc:954] ReplaceTablet: received request to replace tablet 218dfac06cf841c6aced6781154f283a from {username='slave'} at 127.0.0.1:51896
I20260502 20:01:15.265053 13053 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51896:
table { table_name: "default.Table_ac5362bfe46a4090a35bd51ad90c59ad" } modify_external_catalogs: true
I20260502 20:01:15.265738 13053 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51896:
table { table_name: "default.Table_ac5362bfe46a4090a35bd51ad90c59ad" } modify_external_catalogs: true
I20260502 20:01:15.266083 13048 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51896:
table { table_name: "default.Table_e3ad181715724e36aa7276f9790d41bf" } new_table_name: "default.Table_9fb8cc097c6f4bd48e5f41dd70218be1" modify_external_catalogs: true
I20260502 20:01:15.266310 13049 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51896:
table { table_name: "default.Table_d4efc4ecb8b04c828595edb245352971" } new_table_name: "default.Table_fd2a46a7a29e42429193d222c7c5037f" modify_external_catalogs: true
I20260502 20:01:15.269008 13252 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Refusing update from remote peer ef9294b460014382a2a594c77f8900d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 144. Preceding OpId from leader: term: 10 index: 146. (index mismatch)
W20260502 20:01:15.269177 13042 consensus_peers.cc:597] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 -> Peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Couldn't send request to peer 38315e4f56484666b5e54afad02498ec. Status: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260502 20:01:15.272291 13304 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 145, Last known committed idx: 144, Time since last communication: 0.000s
F20260502 20:01:15.272439 13117 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 26, previous 26; dumping first 3 out of 13 received events: NotificationEvent(eventId=25, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_b19cf190454d42ff99d3fcab96f783b1, message={"server":"","servicePrincipal":"","db":"default","table":"table_b19cf190454d42ff99d3fcab96f783b1","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_b19cf190454d42ff99d3fcab96f783b1\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752048},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b19cf190454d42ff99d3fcab96f783b1\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b19cf190454d42ff99d3fcab96f783b1\",\"kudu.table_id\":\"33b0206efcd84429a0b2bc366a81e1fb\",\"transient_lastDdlTime\":\"1777752048\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=ALTER_TABLE, dbName=default, tableName=table_b9b31b57bb724b299b6000678ee9e5a4, message={"server":"","servicePrincipal":"","db":"default","table":"table_24faf39307584530a038ed30536bd4c2","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_24faf39307584530a038ed30536bd4c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_24faf39307584530a038ed30536bd4c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_24faf39307584530a038ed30536bd4c2\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_b9b31b57bb724b299b6000678ee9e5a4\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752047},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_b9b31b57bb724b299b6000678ee9e5a4\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_b9b31b57bb724b299b6000678ee9e5a4\",\"kudu.table_id\":\"69692b57e81f408db409df6a8991a064\",\"transient_lastDdlTime\":\"1777752047\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1777752049}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=26, eventTime=1777752049, eventType=CREATE_TABLE, dbName=default, tableName=table_8ad450efb0df42d2bb35c3f8d3e0b78e, message={"server":"","servicePrincipal":"","db":"default","table":"table_8ad450efb0df42d2bb35c3f8d3e0b78e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777752049},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/warehouse/table_8ad450efb0df42d2bb35c3f8d3e0b78e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_8ad450efb0df42d2bb35c3f8d3e0b78e\",\"kudu.table_id\":\"7d9fa0bb8a9b4877b6bbbac853119f8d\",\"transient_lastDdlTime\":\"1777752049\",\"comment\":\"\",\"kudu.master_addresses\":\"127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"bef656f6f161410aa7c9b68cc234cedf\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777752049,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7fa4b653adcd google::LogMessage::Fail() at ??:0
@ 0x7fa4b653eb93 google::LogMessage::SendToLog() at ??:0
I20260502 20:01:15.278860 13287 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef9294b460014382a2a594c77f8900d4. Latest consensus state: current_term: 10 leader_uuid: "ef9294b460014382a2a594c77f8900d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:15.279037 13287 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fa4b653a7cc google::LogMessage::Flush() at ??:0
I20260502 20:01:15.282450 13304 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 10 leader_uuid: "ef9294b460014382a2a594c77f8900d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:15.282608 13304 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4 [sys.catalog]: This master's current role is: LEADER
@ 0x7fa4b653aa11 google::LogMessage::~LogMessage() at ??:0
I20260502 20:01:15.284227 11319 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:01:15.284269 13287 sys_catalog.cc:455] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 10 leader_uuid: "ef9294b460014382a2a594c77f8900d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } } }
I20260502 20:01:15.284420 13287 sys_catalog.cc:458] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [sys.catalog]: This master's current role is: FOLLOWER
I20260502 20:01:15.286384 11178 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:01:15.286854 13242 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ade741c4062940adb2223b55187ffe72" instance_seqno: 1777752043938024) as {username='slave'} at 127.10.27.131:48117; Asking this server to re-register.
I20260502 20:01:15.287539 11319 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:15.288820 13055 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet c3ab3bbc37b94d6f97081c8fd069749a
I20260502 20:01:15.289007 13241 ts_manager.cc:194] Registered new tserver with Master: ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:01:15.289211 13309 mvcc.cc:204] Tried to move back new op lower bound from 7281672500312154112 to 7281672500036653056. Current Snapshot: MvccSnapshot[applied={T|T < 7281672500291760128}]
I20260502 20:01:15.290104 13055 catalog_manager.cc:6741] ReplaceTablet: tablet c3ab3bbc37b94d6f97081c8fd069749a deleted and replaced by tablet 93809428ca2846eebe783891637a55df
I20260502 20:01:15.291760 13054 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet 218dfac06cf841c6aced6781154f283a
I20260502 20:01:15.292023 13056 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet faafd4c8dd3a4e2ebea018657480f840
I20260502 20:01:15.292050 13054 catalog_manager.cc:6741] ReplaceTablet: tablet 218dfac06cf841c6aced6781154f283a deleted and replaced by tablet 5b34e84883604f8d9ed2540d8cd48a17
I20260502 20:01:15.292265 13056 catalog_manager.cc:6741] ReplaceTablet: tablet faafd4c8dd3a4e2ebea018657480f840 deleted and replaced by tablet 13e55e8fe30847ad9ac943c5a55cfcbe
I20260502 20:01:15.292439 13056 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51896:
table { table_name: "default.Table_24faf39307584530a038ed30536bd4c2" } new_table_name: "default.Table_b9b31b57bb724b299b6000678ee9e5a4" modify_external_catalogs: true
I20260502 20:01:15.293567 13052 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:01:15.293823 13052 catalog_manager.cc:6741] ReplaceTablet: tablet 3cdb6695c99e4da682e33b146b0e51ab deleted and replaced by tablet 31e59d7a17b244f3837db3a2f65aed52
I20260502 20:01:15.294716 13052 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51896:
table { table_name: "default.Table_115178421c134252971c7a71b1134464" } new_table_name: "default.Table_9b0b95067a6444d783041819f979eb27" modify_external_catalogs: true
I20260502 20:01:15.295074 13057 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ef9294b460014382a2a594c77f8900d4: Sending DeleteTablet for 3 replicas of tablet 9df3ebd756b248d0b92bad3259e7a122
@ 0x7fa4bbaae433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 20:01:15.295439 13057 catalog_manager.cc:6741] ReplaceTablet: tablet 9df3ebd756b248d0b92bad3259e7a122 deleted and replaced by tablet 554b472403684d50a1b463575a09fee3
I20260502 20:01:15.295640 13057 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51896:
name: "default.Table_c1f90f27e25c436bb0c43af980cece1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:01:15.296911 11043 heartbeater.cc:344] Connected to a master server at 127.10.27.188:33369
I20260502 20:01:15.297133 11043 heartbeater.cc:499] Master 127.10.27.188:33369 was elected leader, sending a full tablet report...
I20260502 20:01:15.298753 13241 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" instance_seqno: 1777752043533877) as {username='slave'} at 127.10.27.129:53177; Asking this server to re-register.
I20260502 20:01:15.299290 11043 heartbeater.cc:461] Registering TS with master...
I20260502 20:01:15.300328 13241 ts_manager.cc:194] Registered new tserver with Master: 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
I20260502 20:01:15.301076 13242 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" instance_seqno: 1777752043728997) as {username='slave'} at 127.10.27.130:54555; Asking this server to re-register.
I20260502 20:01:15.292227 13054 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51896:
table { table_name: "default.Table_ae16bd7eeae84bcc9df91b677d29e577" } modify_external_catalogs: true
I20260502 20:01:15.301270 13054 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51896:
table { table_name: "default.Table_ae16bd7eeae84bcc9df91b677d29e577" } modify_external_catalogs: true
I20260502 20:01:15.301548 11178 heartbeater.cc:461] Registering TS with master...
@ 0x7fa4bbaad34a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 20:01:15.302043 13055 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51896:
name: "default.Table_8fe0445705b144e5adbda1bd0c71ba52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 20:01:15.302524 13242 ts_manager.cc:194] Registered new tserver with Master: b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
@ 0x7fa4bbaacaad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
@ 0x7fa4bbab21b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x55efddb5c244 std::function<>::operator()() at ??:0
@ 0x7fa4b7a3f7ea kudu::Thread::SuperviseThread() at ??:0
@ 0x7fa4b83836db start_thread at ??:0
I20260502 20:01:15.317643 11111 tablet_service.cc:1558] Processing DeleteTablet for tablet c3ab3bbc37b94d6f97081c8fd069749a with delete_type TABLET_DATA_DELETED (replaced by tablet 93809428ca2846eebe783891637a55df) from {username='slave'} at 127.0.0.1:51082
I20260502 20:01:15.317922 11109 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cdb6695c99e4da682e33b146b0e51ab with delete_type TABLET_DATA_DELETED (replaced by tablet 31e59d7a17b244f3837db3a2f65aed52) from {username='slave'} at 127.0.0.1:51082
I20260502 20:01:15.318063 11110 tablet_service.cc:1558] Processing DeleteTablet for tablet 218dfac06cf841c6aced6781154f283a with delete_type TABLET_DATA_DELETED (replaced by tablet 5b34e84883604f8d9ed2540d8cd48a17) from {username='slave'} at 127.0.0.1:51082
I20260502 20:01:15.318159 11112 tablet_service.cc:1558] Processing DeleteTablet for tablet faafd4c8dd3a4e2ebea018657480f840 with delete_type TABLET_DATA_DELETED (replaced by tablet 13e55e8fe30847ad9ac943c5a55cfcbe) from {username='slave'} at 127.0.0.1:51082
I20260502 20:01:15.318239 11107 tablet_service.cc:1511] Processing CreateTablet for tablet 5b34e84883604f8d9ed2540d8cd48a17 (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:15.318269 11108 tablet_service.cc:1511] Processing CreateTablet for tablet 13e55e8fe30847ad9ac943c5a55cfcbe (DEFAULT_TABLE table=default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:15.318529 11107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b34e84883604f8d9ed2540d8cd48a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:15.318243 11106 tablet_service.cc:1558] Processing DeleteTablet for tablet 9df3ebd756b248d0b92bad3259e7a122 with delete_type TABLET_DATA_DELETED (replaced by tablet 554b472403684d50a1b463575a09fee3) from {username='slave'} at 127.0.0.1:51082
I20260502 20:01:15.318783 11108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e55e8fe30847ad9ac943c5a55cfcbe. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fa4b56f161f clone at ??:0
I20260502 20:01:15.318998 11111 tablet_service.cc:1511] Processing CreateTablet for tablet 93809428ca2846eebe783891637a55df (DEFAULT_TABLE table=default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:15.319190 11111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93809428ca2846eebe783891637a55df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:15.320475 10971 tablet_service.cc:1511] Processing CreateTablet for tablet 93809428ca2846eebe783891637a55df (DEFAULT_TABLE table=default.table_0d8473dff6e244c199473f589d46be1b [id=7b1dce0350184df085c1148baa6c931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:15.320757 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93809428ca2846eebe783891637a55df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:15.321000 10972 tablet_service.cc:1558] Processing DeleteTablet for tablet c3ab3bbc37b94d6f97081c8fd069749a with delete_type TABLET_DATA_DELETED (replaced by tablet 93809428ca2846eebe783891637a55df) from {username='slave'} at 127.0.0.1:38842
I20260502 20:01:15.321249 10977 tablet_service.cc:1558] Processing DeleteTablet for tablet 218dfac06cf841c6aced6781154f283a with delete_type TABLET_DATA_DELETED (replaced by tablet 5b34e84883604f8d9ed2540d8cd48a17) from {username='slave'} at 127.0.0.1:38842
I20260502 20:01:15.321370 10975 tablet_service.cc:1558] Processing DeleteTablet for tablet faafd4c8dd3a4e2ebea018657480f840 with delete_type TABLET_DATA_DELETED (replaced by tablet 13e55e8fe30847ad9ac943c5a55cfcbe) from {username='slave'} at 127.0.0.1:38842
I20260502 20:01:15.321477 10973 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cdb6695c99e4da682e33b146b0e51ab with delete_type TABLET_DATA_DELETED (replaced by tablet 31e59d7a17b244f3837db3a2f65aed52) from {username='slave'} at 127.0.0.1:38842
I20260502 20:01:15.321583 10976 tablet_service.cc:1558] Processing DeleteTablet for tablet 9df3ebd756b248d0b92bad3259e7a122 with delete_type TABLET_DATA_DELETED (replaced by tablet 554b472403684d50a1b463575a09fee3) from {username='slave'} at 127.0.0.1:38842
I20260502 20:01:15.321786 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 5b34e84883604f8d9ed2540d8cd48a17 (DEFAULT_TABLE table=default.table_ae16bd7eeae84bcc9df91b677d29e577 [id=a0a56f4db1d84c11963490879dc9d66f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:15.322009 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b34e84883604f8d9ed2540d8cd48a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:15.323170 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 13e55e8fe30847ad9ac943c5a55cfcbe (DEFAULT_TABLE table=default.table_7ce0c3c1163d4f549db7f3204c01f5ae [id=c3e6566d144540e9af6052d08b2c4dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 20:01:15.323467 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e55e8fe30847ad9ac943c5a55cfcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:15.323532 13328 tablet_bootstrap.cc:492] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:01:15.324604 13328 tablet_bootstrap.cc:654] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:15.325286 13329 tablet_replica.cc:333] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:15.325412 13329 raft_consensus.cc:2243] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:15.325516 13329 raft_consensus.cc:2272] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:15.325860 13329 ts_tablet_manager.cc:1916] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:15.327737 13330 tablet_bootstrap.cc:492] T 93809428ca2846eebe783891637a55df P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:01:15.327872 13329 ts_tablet_manager.cc:1929] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:15.327937 13329 log.cc:1199] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/c3ab3bbc37b94d6f97081c8fd069749a
I20260502 20:01:15.328193 13329 ts_tablet_manager.cc:1950] T c3ab3bbc37b94d6f97081c8fd069749a P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:15.328451 13327 tablet_replica.cc:333] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:15.328573 13327 raft_consensus.cc:2243] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:15.328683 13327 raft_consensus.cc:2272] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:15.329005 13330 tablet_bootstrap.cc:654] T 93809428ca2846eebe783891637a55df P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:15.329078 13327 ts_tablet_manager.cc:1916] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:15.329504 13328 tablet_bootstrap.cc:492] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:01:15.329589 13328 ts_tablet_manager.cc:1403] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260502 20:01:15.330231 13328 raft_consensus.cc:359] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.330364 13328 raft_consensus.cc:385] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:15.330402 13328 raft_consensus.cc:740] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:01:15.332198 13327 ts_tablet_manager.cc:1929] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:15.332261 13327 log.cc:1199] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/c3ab3bbc37b94d6f97081c8fd069749a
I20260502 20:01:15.332430 13329 tablet_replica.cc:333] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:15.332526 13327 ts_tablet_manager.cc:1950] T c3ab3bbc37b94d6f97081c8fd069749a P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:15.332574 13329 raft_consensus.cc:2243] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:15.332680 13329 raft_consensus.cc:2272] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:15.332696 13328 consensus_queue.cc:260] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.333061 13329 ts_tablet_manager.cc:1916] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:15.333122 13328 ts_tablet_manager.cc:1434] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 20:01:15.333319 11180 heartbeater.cc:499] Master 127.10.27.189:46281 was elected leader, sending a full tablet report...
I20260502 20:01:15.333827 13327 tablet_replica.cc:333] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:15.333945 13327 raft_consensus.cc:2243] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:01:15.334107 13327 raft_consensus.cc:2272] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:15.334427 13327 ts_tablet_manager.cc:1916] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:15.336629 13327 ts_tablet_manager.cc:1929] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:15.336719 13327 log.cc:1199] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:01:15.336987 13327 ts_tablet_manager.cc:1950] T 3cdb6695c99e4da682e33b146b0e51ab P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:15.333341 13328 tablet_bootstrap.cc:492] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:01:15.337845 13327 tablet_replica.cc:333] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:15.338156 13330 tablet_bootstrap.cc:492] T 93809428ca2846eebe783891637a55df P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:01:15.338227 13327 raft_consensus.cc:2243] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:15.338246 13330 ts_tablet_manager.cc:1403] T 93809428ca2846eebe783891637a55df P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260502 20:01:15.338338 13327 raft_consensus.cc:2272] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:15.338658 13327 ts_tablet_manager.cc:1916] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:15.338785 13328 tablet_bootstrap.cc:654] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:15.338722 13330 raft_consensus.cc:359] T 93809428ca2846eebe783891637a55df P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.338852 13330 raft_consensus.cc:385] T 93809428ca2846eebe783891637a55df P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:15.338888 13330 raft_consensus.cc:740] T 93809428ca2846eebe783891637a55df P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:01:15.339056 13330 consensus_queue.cc:260] T 93809428ca2846eebe783891637a55df P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.339377 13330 ts_tablet_manager.cc:1434] T 93809428ca2846eebe783891637a55df P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 20:01:15.339614 11045 heartbeater.cc:499] Master 127.10.27.189:46281 was elected leader, sending a full tablet report...
I20260502 20:01:15.340802 13327 ts_tablet_manager.cc:1929] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:15.340864 13327 log.cc:1199] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/218dfac06cf841c6aced6781154f283a
I20260502 20:01:15.341106 13327 ts_tablet_manager.cc:1950] T 218dfac06cf841c6aced6781154f283a P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:15.341693 13327 tablet_replica.cc:333] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:15.341809 13327 raft_consensus.cc:2243] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:01:15.341972 13327 raft_consensus.cc:2272] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:15.342314 13327 ts_tablet_manager.cc:1916] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:15.342308 13329 ts_tablet_manager.cc:1929] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:15.342376 13329 log.cc:1199] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/218dfac06cf841c6aced6781154f283a
I20260502 20:01:15.342628 13329 ts_tablet_manager.cc:1950] T 218dfac06cf841c6aced6781154f283a P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:15.344089 13327 ts_tablet_manager.cc:1929] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:15.344151 13327 log.cc:1199] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/faafd4c8dd3a4e2ebea018657480f840
I20260502 20:01:15.344391 13327 ts_tablet_manager.cc:1950] T faafd4c8dd3a4e2ebea018657480f840 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:15.344784 13329 tablet_replica.cc:333] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:15.344903 13329 raft_consensus.cc:2243] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:15.345011 13329 raft_consensus.cc:2272] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:15.345381 13329 ts_tablet_manager.cc:1916] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:15.347406 13329 ts_tablet_manager.cc:1929] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:15.347470 13329 log.cc:1199] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/faafd4c8dd3a4e2ebea018657480f840
I20260502 20:01:15.347708 13329 ts_tablet_manager.cc:1950] T faafd4c8dd3a4e2ebea018657480f840 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:15.347981 13330 tablet_bootstrap.cc:492] T 13e55e8fe30847ad9ac943c5a55cfcbe P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:01:15.349047 13330 tablet_bootstrap.cc:654] T 13e55e8fe30847ad9ac943c5a55cfcbe P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:15.350217 13330 tablet_bootstrap.cc:492] T 13e55e8fe30847ad9ac943c5a55cfcbe P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:01:15.350302 13330 ts_tablet_manager.cc:1403] T 13e55e8fe30847ad9ac943c5a55cfcbe P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260502 20:01:15.350309 13327 tablet_replica.cc:333] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1: stopping tablet replica
I20260502 20:01:15.350449 13327 raft_consensus.cc:2243] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Raft consensus shutting down.
I20260502 20:01:15.350630 13327 raft_consensus.cc:2272] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:15.350908 13330 raft_consensus.cc:359] T 13e55e8fe30847ad9ac943c5a55cfcbe P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.351104 13330 raft_consensus.cc:385] T 13e55e8fe30847ad9ac943c5a55cfcbe P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:15.351154 13330 raft_consensus.cc:740] T 13e55e8fe30847ad9ac943c5a55cfcbe P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:01:15.351303 13330 consensus_queue.cc:260] T 13e55e8fe30847ad9ac943c5a55cfcbe P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.351470 13329 tablet_replica.cc:333] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:15.351629 13330 ts_tablet_manager.cc:1434] T 13e55e8fe30847ad9ac943c5a55cfcbe P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260502 20:01:15.351680 13327 ts_tablet_manager.cc:1916] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:15.351797 13330 tablet_bootstrap.cc:492] T 5b34e84883604f8d9ed2540d8cd48a17 P 858db0bc9f07476e9d1540f2b095414f: Bootstrap starting.
I20260502 20:01:15.352874 13330 tablet_bootstrap.cc:654] T 5b34e84883604f8d9ed2540d8cd48a17 P 858db0bc9f07476e9d1540f2b095414f: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:15.353483 13329 raft_consensus.cc:2243] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:15.353602 13329 raft_consensus.cc:2272] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:15.353794 13327 ts_tablet_manager.cc:1929] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:15.353857 13327 log.cc:1199] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-1/wal/wals/9df3ebd756b248d0b92bad3259e7a122
I20260502 20:01:15.354024 13329 ts_tablet_manager.cc:1916] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:15.354099 13327 ts_tablet_manager.cc:1950] T 9df3ebd756b248d0b92bad3259e7a122 P b85d150f168f406bb31ff44150b2b1a1: Deleting consensus metadata
I20260502 20:01:15.354774 13328 tablet_bootstrap.cc:492] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:01:15.354851 13328 ts_tablet_manager.cc:1403] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.001s
I20260502 20:01:15.355360 13328 raft_consensus.cc:359] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.355460 13328 raft_consensus.cc:385] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:15.355489 13328 raft_consensus.cc:740] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:01:15.355609 13328 consensus_queue.cc:260] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.355863 13328 ts_tablet_manager.cc:1434] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 20:01:15.356159 13328 tablet_bootstrap.cc:492] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1: Bootstrap starting.
I20260502 20:01:15.356591 13329 ts_tablet_manager.cc:1929] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:15.356668 13329 log.cc:1199] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:01:15.356935 13329 ts_tablet_manager.cc:1950] T 3cdb6695c99e4da682e33b146b0e51ab P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:15.357402 13328 tablet_bootstrap.cc:654] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1: Neither blocks nor log segments found. Creating new log.
I20260502 20:01:15.358493 13330 tablet_bootstrap.cc:492] T 5b34e84883604f8d9ed2540d8cd48a17 P 858db0bc9f07476e9d1540f2b095414f: No bootstrap required, opened a new log
I20260502 20:01:15.358568 13330 ts_tablet_manager.cc:1403] T 5b34e84883604f8d9ed2540d8cd48a17 P 858db0bc9f07476e9d1540f2b095414f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260502 20:01:15.359053 13330 raft_consensus.cc:359] T 5b34e84883604f8d9ed2540d8cd48a17 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.359182 13330 raft_consensus.cc:385] T 5b34e84883604f8d9ed2540d8cd48a17 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:15.359217 13330 raft_consensus.cc:740] T 5b34e84883604f8d9ed2540d8cd48a17 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 858db0bc9f07476e9d1540f2b095414f, State: Initialized, Role: FOLLOWER
I20260502 20:01:15.359385 13330 consensus_queue.cc:260] T 5b34e84883604f8d9ed2540d8cd48a17 P 858db0bc9f07476e9d1540f2b095414f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.361124 13330 ts_tablet_manager.cc:1434] T 5b34e84883604f8d9ed2540d8cd48a17 P 858db0bc9f07476e9d1540f2b095414f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 20:01:15.363374 13328 tablet_bootstrap.cc:492] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1: No bootstrap required, opened a new log
I20260502 20:01:15.363468 13328 ts_tablet_manager.cc:1403] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s
I20260502 20:01:15.363960 13328 raft_consensus.cc:359] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.364065 13328 raft_consensus.cc:385] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 20:01:15.364096 13328 raft_consensus.cc:740] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Initialized, Role: FOLLOWER
I20260502 20:01:15.364217 13328 consensus_queue.cc:260] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.366302 13328 ts_tablet_manager.cc:1434] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260502 20:01:15.369346 13329 tablet_replica.cc:333] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f: stopping tablet replica
I20260502 20:01:15.369478 13329 raft_consensus.cc:2243] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 20:01:15.369575 13329 raft_consensus.cc:2272] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 20:01:15.369966 13329 ts_tablet_manager.cc:1916] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 20:01:15.372368 13329 ts_tablet_manager.cc:1929] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 20:01:15.372438 13329 log.cc:1199] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f: Deleting WAL directory at /tmp/dist-test-taskpeoj1k/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777752026304382-10350-0/minicluster-data/ts-0/wal/wals/9df3ebd756b248d0b92bad3259e7a122
I20260502 20:01:15.372678 13329 ts_tablet_manager.cc:1950] T 9df3ebd756b248d0b92bad3259e7a122 P 858db0bc9f07476e9d1540f2b095414f: Deleting consensus metadata
I20260502 20:01:15.415640 13334 raft_consensus.cc:493] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:15.415786 13334 raft_consensus.cc:515] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.416388 13334 leader_election.cc:290] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:01:15.417047 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93809428ca2846eebe783891637a55df" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:01:15.417199 10982 raft_consensus.cc:2468] T 93809428ca2846eebe783891637a55df P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
W20260502 20:01:15.417214 11065 leader_election.cc:343] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Not found: Tablet not found: 93809428ca2846eebe783891637a55df
I20260502 20:01:15.417479 11065 leader_election.cc:304] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters: ade741c4062940adb2223b55187ffe72
I20260502 20:01:15.417677 13334 raft_consensus.cc:2804] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:01:15.417753 13334 raft_consensus.cc:493] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:01:15.417795 13334 raft_consensus.cc:3060] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:15.419062 13334 raft_consensus.cc:515] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.419461 13334 leader_election.cc:290] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:01:15.419836 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93809428ca2846eebe783891637a55df" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:01:15.419975 10982 raft_consensus.cc:3060] T 93809428ca2846eebe783891637a55df P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
W20260502 20:01:15.420145 11065 leader_election.cc:343] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Not found: Tablet not found: 93809428ca2846eebe783891637a55df
I20260502 20:01:15.421025 10982 raft_consensus.cc:2468] T 93809428ca2846eebe783891637a55df P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:01:15.421350 11065 leader_election.cc:304] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters: ade741c4062940adb2223b55187ffe72
I20260502 20:01:15.421586 13334 raft_consensus.cc:2804] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:01:15.422194 13334 raft_consensus.cc:697] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:01:15.422413 13334 consensus_queue.cc:237] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
W20260502 20:01:15.424276 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 1: this message will repeat every 5th retry.
I20260502 20:01:15.461436 13334 raft_consensus.cc:493] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:15.461578 13334 raft_consensus.cc:515] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.462131 13334 leader_election.cc:290] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:01:15.462713 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b34e84883604f8d9ed2540d8cd48a17" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:01:15.462884 10982 raft_consensus.cc:2468] T 5b34e84883604f8d9ed2540d8cd48a17 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
W20260502 20:01:15.463044 11065 leader_election.cc:343] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Not found: Tablet not found: 5b34e84883604f8d9ed2540d8cd48a17
I20260502 20:01:15.463212 11065 leader_election.cc:304] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters: ade741c4062940adb2223b55187ffe72
I20260502 20:01:15.463423 13334 raft_consensus.cc:2804] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:01:15.463524 13334 raft_consensus.cc:493] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 20:01:15.463584 13334 raft_consensus.cc:3060] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:15.464435 13334 raft_consensus.cc:515] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.464778 13334 leader_election.cc:290] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:01:15.465152 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b34e84883604f8d9ed2540d8cd48a17" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:01:15.465286 10982 raft_consensus.cc:3060] T 5b34e84883604f8d9ed2540d8cd48a17 P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
W20260502 20:01:15.465703 11065 leader_election.cc:343] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Not found: Tablet not found: 5b34e84883604f8d9ed2540d8cd48a17
I20260502 20:01:15.466190 10982 raft_consensus.cc:2468] T 5b34e84883604f8d9ed2540d8cd48a17 P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:01:15.466495 11065 leader_election.cc:304] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters: ade741c4062940adb2223b55187ffe72
I20260502 20:01:15.466672 13334 raft_consensus.cc:2804] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:01:15.466813 13334 raft_consensus.cc:697] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:01:15.466984 13334 consensus_queue.cc:237] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
W20260502 20:01:15.479625 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 1: this message will repeat every 5th retry.
W20260502 20:01:15.528725 11065 connection.cc:570] server connection from 127.0.0.1:51082 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:15.528806 10931 connection.cc:570] server connection from 127.0.0.1:38842 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:15.529863 10930 connection.cc:570] client connection to 127.10.27.189:46281 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:15.530215 11065 connection.cc:570] client connection to 127.10.27.189:46281 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:15.530414 13322 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 20:01:15.291211 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:53458 (local address 127.10.27.131:43389)
0502 20:01:15.306665 (+ 15454us) server_negotiation.cc:207] Beginning negotiation
0502 20:01:15.306669 (+ 4us) server_negotiation.cc:400] Waiting for connection header
0502 20:01:15.306682 (+ 13us) server_negotiation.cc:408] Connection header received
0502 20:01:15.306747 (+ 65us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0502 20:01:15.306751 (+ 4us) server_negotiation.cc:462] Received NEGOTIATE request from client
0502 20:01:15.306798 (+ 47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0502 20:01:15.310890 (+ 4092us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0502 20:01:15.311218 (+ 328us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0502 20:01:15.312008 (+ 790us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0502 20:01:15.530243 (+218235us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53458: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":15373,"thread_start_us":74,"threads_started":1}
W20260502 20:01:15.530615 11326 connection.cc:570] client connection to 127.10.27.189:46281 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 20:01:15.531322 11326 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.10.27.189:46281)
W20260502 20:01:15.531669 11326 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.27.189:46281)
W20260502 20:01:15.531816 11326 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.10.27.189:46281)
W20260502 20:01:15.532294 11326 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.10.27.189:46281)
I20260502 20:01:15.559055 13334 raft_consensus.cc:493] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 20:01:15.559258 13334 raft_consensus.cc:515] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.559693 13334 leader_election.cc:290] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:01:15.560344 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e55e8fe30847ad9ac943c5a55cfcbe" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f" is_pre_election: true
I20260502 20:01:15.560490 10982 raft_consensus.cc:2468] T 13e55e8fe30847ad9ac943c5a55cfcbe P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 0.
I20260502 20:01:15.560824 11065 leader_election.cc:304] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters:
I20260502 20:01:15.561003 13334 raft_consensus.cc:2804] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 20:01:15.561064 13334 raft_consensus.cc:493] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260502 20:01:15.561048 11065 leader_election.cc:343] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Not found: Tablet not found: 13e55e8fe30847ad9ac943c5a55cfcbe
I20260502 20:01:15.561117 13334 raft_consensus.cc:3060] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260502 20:01:15.561970 13334 raft_consensus.cc:515] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:15.562350 13334 leader_election.cc:290] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Requested vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389)
I20260502 20:01:15.562677 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e55e8fe30847ad9ac943c5a55cfcbe" candidate_uuid: "b85d150f168f406bb31ff44150b2b1a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "858db0bc9f07476e9d1540f2b095414f"
I20260502 20:01:15.562846 10982 raft_consensus.cc:3060] T 13e55e8fe30847ad9ac943c5a55cfcbe P 858db0bc9f07476e9d1540f2b095414f [term 0 FOLLOWER]: Advancing to term 1
W20260502 20:01:15.563097 11065 leader_election.cc:343] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Not found: Tablet not found: 13e55e8fe30847ad9ac943c5a55cfcbe
I20260502 20:01:15.563836 10982 raft_consensus.cc:2468] T 13e55e8fe30847ad9ac943c5a55cfcbe P 858db0bc9f07476e9d1540f2b095414f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b85d150f168f406bb31ff44150b2b1a1 in term 1.
I20260502 20:01:15.564149 11065 leader_election.cc:304] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1; no voters: ade741c4062940adb2223b55187ffe72
I20260502 20:01:15.564313 13334 raft_consensus.cc:2804] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 20:01:15.564419 13334 raft_consensus.cc:697] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [term 1 LEADER]: Becoming Leader. State: Replica: b85d150f168f406bb31ff44150b2b1a1, State: Running, Role: LEADER
I20260502 20:01:15.564558 13334 consensus_queue.cc:237] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
W20260502 20:01:15.600966 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 1: this message will repeat every 5th retry.
W20260502 20:01:15.656723 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 1: this message will repeat every 5th retry.
I20260502 20:01:15.802135 11321 heartbeater.cc:499] Master 127.10.27.189:46281 was elected leader, sending a full tablet report...
I20260502 20:01:15.818070 13352 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:15.818223 13352 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:15.819788 13352 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:15.820398 13226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:15.821172 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:15.821323 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:15.821403 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:15.821602 13352 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:01:15.866315 11065 consensus_peers.cc:597] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 -> Peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Couldn't send request to peer ade741c4062940adb2223b55187ffe72. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 93809428ca2846eebe783891637a55df. This is attempt 1: this message will repeat every 5th retry.
I20260502 20:01:15.902273 13334 consensus_queue.cc:1048] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 20:01:15.906599 11065 consensus_peers.cc:597] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1 -> Peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Couldn't send request to peer ade741c4062940adb2223b55187ffe72. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b34e84883604f8d9ed2540d8cd48a17. This is attempt 1: this message will repeat every 5th retry.
I20260502 20:01:15.928249 13362 consensus_queue.cc:1048] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 20:01:16.035354 13190 consensus_queue.cc:1048] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 20:01:16.038709 11065 consensus_peers.cc:597] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1 -> Peer ade741c4062940adb2223b55187ffe72 (127.10.27.131:43389): Couldn't send request to peer ade741c4062940adb2223b55187ffe72. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13e55e8fe30847ad9ac943c5a55cfcbe. This is attempt 1: this message will repeat every 5th retry.
I20260502 20:01:16.276309 13369 ts_tablet_manager.cc:933] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72: Initiating tablet copy from peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:16.276736 13369 tablet_copy_client.cc:323] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72: tablet copy: Beginning tablet copy session from remote peer at address 127.10.27.130:43285
I20260502 20:01:16.277294 11152 tablet_copy_service.cc:140] P b85d150f168f406bb31ff44150b2b1a1: Received BeginTabletCopySession request for tablet 93809428ca2846eebe783891637a55df from peer ade741c4062940adb2223b55187ffe72 ({username='slave'} at 127.10.27.131:59643)
I20260502 20:01:16.277400 11152 tablet_copy_service.cc:161] P b85d150f168f406bb31ff44150b2b1a1: Beginning new tablet copy session on tablet 93809428ca2846eebe783891637a55df from peer ade741c4062940adb2223b55187ffe72 at {username='slave'} at 127.10.27.131:59643: session id = ade741c4062940adb2223b55187ffe72-93809428ca2846eebe783891637a55df
I20260502 20:01:16.278244 11152 tablet_copy_source_session.cc:215] T 93809428ca2846eebe783891637a55df P b85d150f168f406bb31ff44150b2b1a1: Tablet Copy: opened 0 blocks and 1 log segments
I20260502 20:01:16.279161 13369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93809428ca2846eebe783891637a55df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:16.280905 13369 tablet_copy_client.cc:806] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72: tablet copy: Starting download of 0 data blocks...
I20260502 20:01:16.281082 13369 tablet_copy_client.cc:670] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72: tablet copy: Starting download of 1 WAL segments...
I20260502 20:01:16.282230 13369 tablet_copy_client.cc:538] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260502 20:01:16.283329 13369 tablet_bootstrap.cc:492] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:01:16.287027 13369 tablet_bootstrap.cc:492] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:01:16.287340 13369 tablet_bootstrap.cc:492] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72: Bootstrap complete.
I20260502 20:01:16.287545 13369 ts_tablet_manager.cc:1403] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260502 20:01:16.288040 13369 raft_consensus.cc:359] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:16.288144 13369 raft_consensus.cc:740] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:01:16.288316 13369 consensus_queue.cc:260] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:16.288647 13369 ts_tablet_manager.cc:1434] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:01:16.289346 11152 tablet_copy_service.cc:342] P b85d150f168f406bb31ff44150b2b1a1: Request end of tablet copy session ade741c4062940adb2223b55187ffe72-93809428ca2846eebe783891637a55df received from {username='slave'} at 127.10.27.131:59643
I20260502 20:01:16.289446 11152 tablet_copy_service.cc:434] P b85d150f168f406bb31ff44150b2b1a1: ending tablet copy session ade741c4062940adb2223b55187ffe72-93809428ca2846eebe783891637a55df on tablet 93809428ca2846eebe783891637a55df with peer ade741c4062940adb2223b55187ffe72
I20260502 20:01:16.445291 13369 ts_tablet_manager.cc:933] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72: Initiating tablet copy from peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:16.445652 13369 tablet_copy_client.cc:323] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72: tablet copy: Beginning tablet copy session from remote peer at address 127.10.27.130:43285
I20260502 20:01:16.446202 11152 tablet_copy_service.cc:140] P b85d150f168f406bb31ff44150b2b1a1: Received BeginTabletCopySession request for tablet 5b34e84883604f8d9ed2540d8cd48a17 from peer ade741c4062940adb2223b55187ffe72 ({username='slave'} at 127.10.27.131:59643)
I20260502 20:01:16.446322 11152 tablet_copy_service.cc:161] P b85d150f168f406bb31ff44150b2b1a1: Beginning new tablet copy session on tablet 5b34e84883604f8d9ed2540d8cd48a17 from peer ade741c4062940adb2223b55187ffe72 at {username='slave'} at 127.10.27.131:59643: session id = ade741c4062940adb2223b55187ffe72-5b34e84883604f8d9ed2540d8cd48a17
I20260502 20:01:16.447441 11152 tablet_copy_source_session.cc:215] T 5b34e84883604f8d9ed2540d8cd48a17 P b85d150f168f406bb31ff44150b2b1a1: Tablet Copy: opened 0 blocks and 1 log segments
I20260502 20:01:16.448333 13369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b34e84883604f8d9ed2540d8cd48a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:16.450095 13369 tablet_copy_client.cc:806] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72: tablet copy: Starting download of 0 data blocks...
I20260502 20:01:16.450248 13369 tablet_copy_client.cc:670] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72: tablet copy: Starting download of 1 WAL segments...
I20260502 20:01:16.451547 13369 tablet_copy_client.cc:538] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260502 20:01:16.452666 13369 tablet_bootstrap.cc:492] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:01:16.455734 13369 tablet_bootstrap.cc:492] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:01:16.456007 13369 tablet_bootstrap.cc:492] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72: Bootstrap complete.
I20260502 20:01:16.456187 13369 ts_tablet_manager.cc:1403] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260502 20:01:16.456665 13369 raft_consensus.cc:359] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:16.456791 13369 raft_consensus.cc:740] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:01:16.456944 13369 consensus_queue.cc:260] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:16.457245 13369 ts_tablet_manager.cc:1434] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:01:16.457818 11152 tablet_copy_service.cc:342] P b85d150f168f406bb31ff44150b2b1a1: Request end of tablet copy session ade741c4062940adb2223b55187ffe72-5b34e84883604f8d9ed2540d8cd48a17 received from {username='slave'} at 127.10.27.131:59643
I20260502 20:01:16.457913 11152 tablet_copy_service.cc:434] P b85d150f168f406bb31ff44150b2b1a1: ending tablet copy session ade741c4062940adb2223b55187ffe72-5b34e84883604f8d9ed2540d8cd48a17 on tablet 5b34e84883604f8d9ed2540d8cd48a17 with peer ade741c4062940adb2223b55187ffe72
I20260502 20:01:16.488643 13374 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:16.488807 13374 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:16.489336 13374 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:16.490783 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:16.490993 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:16.491079 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:16.491271 13374 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:01:16.492964 13357 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:16.493080 13357 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:16.493564 13357 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:16.494259 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:01:16.494351 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:01:16.494449 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:16.494596 13357 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:16.511080 13369 ts_tablet_manager.cc:933] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72: Initiating tablet copy from peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
I20260502 20:01:16.511435 13369 tablet_copy_client.cc:323] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72: tablet copy: Beginning tablet copy session from remote peer at address 127.10.27.130:43285
I20260502 20:01:16.511926 11152 tablet_copy_service.cc:140] P b85d150f168f406bb31ff44150b2b1a1: Received BeginTabletCopySession request for tablet 13e55e8fe30847ad9ac943c5a55cfcbe from peer ade741c4062940adb2223b55187ffe72 ({username='slave'} at 127.10.27.131:59643)
I20260502 20:01:16.512030 11152 tablet_copy_service.cc:161] P b85d150f168f406bb31ff44150b2b1a1: Beginning new tablet copy session on tablet 13e55e8fe30847ad9ac943c5a55cfcbe from peer ade741c4062940adb2223b55187ffe72 at {username='slave'} at 127.10.27.131:59643: session id = ade741c4062940adb2223b55187ffe72-13e55e8fe30847ad9ac943c5a55cfcbe
I20260502 20:01:16.512742 11152 tablet_copy_source_session.cc:215] T 13e55e8fe30847ad9ac943c5a55cfcbe P b85d150f168f406bb31ff44150b2b1a1: Tablet Copy: opened 0 blocks and 1 log segments
I20260502 20:01:16.513549 13369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e55e8fe30847ad9ac943c5a55cfcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 20:01:16.515337 13369 tablet_copy_client.cc:806] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72: tablet copy: Starting download of 0 data blocks...
I20260502 20:01:16.515503 13369 tablet_copy_client.cc:670] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72: tablet copy: Starting download of 1 WAL segments...
I20260502 20:01:16.516775 13369 tablet_copy_client.cc:538] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260502 20:01:16.518309 13369 tablet_bootstrap.cc:492] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72: Bootstrap starting.
I20260502 20:01:16.522585 13369 tablet_bootstrap.cc:492] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 20:01:16.522845 13369 tablet_bootstrap.cc:492] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72: Bootstrap complete.
I20260502 20:01:16.523049 13369 ts_tablet_manager.cc:1403] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.005s
I20260502 20:01:16.523748 13369 raft_consensus.cc:359] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:16.523906 13369 raft_consensus.cc:740] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade741c4062940adb2223b55187ffe72, State: Initialized, Role: FOLLOWER
I20260502 20:01:16.524052 13369 consensus_queue.cc:260] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:16.524385 13369 ts_tablet_manager.cc:1434] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 20:01:16.525292 11152 tablet_copy_service.cc:342] P b85d150f168f406bb31ff44150b2b1a1: Request end of tablet copy session ade741c4062940adb2223b55187ffe72-13e55e8fe30847ad9ac943c5a55cfcbe received from {username='slave'} at 127.10.27.131:59643
I20260502 20:01:16.525429 11152 tablet_copy_service.cc:434] P b85d150f168f406bb31ff44150b2b1a1: ending tablet copy session ade741c4062940adb2223b55187ffe72-13e55e8fe30847ad9ac943c5a55cfcbe on tablet 13e55e8fe30847ad9ac943c5a55cfcbe with peer ade741c4062940adb2223b55187ffe72
I20260502 20:01:16.538546 13356 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:16.538677 13356 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:16.539213 13356 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:16.540050 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:01:16.540454 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:01:16.540571 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:16.540717 13356 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:16.587699 13356 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:16.587826 13356 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:16.588572 13356 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:16.589201 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:01:16.589316 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:01:16.589432 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:16.589572 13356 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:16.698971 11272 raft_consensus.cc:1217] T 93809428ca2846eebe783891637a55df P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260502 20:01:16.762050 13356 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:16.762213 13356 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:16.762708 13356 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:16.763551 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:01:16.763669 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:01:16.763738 11209 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:16.763859 13356 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:16.960902 11272 raft_consensus.cc:1217] T 13e55e8fe30847ad9ac943c5a55cfcbe P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260502 20:01:17.069103 11272 raft_consensus.cc:1217] T 5b34e84883604f8d9ed2540d8cd48a17 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260502 20:01:17.442667 13356 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:17.442818 13356 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:17.443382 13356 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:01:17.444096 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:01:17.444205 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:01:17.444276 11209 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:17.444484 13356 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:17.490371 10350 master-stress-test.cc:577] Killing test thread 1/25
I20260502 20:01:17.611227 13393 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:17.611366 13393 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:17.611866 13393 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:17.613258 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:17.613432 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:17.613521 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:17.613665 13393 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:01:17.805225 13356 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:17.805363 13356 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:17.805821 13356 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:17.806686 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:01:17.806792 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:01:17.807013 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:17.807219 13356 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:18.271162 13205 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:18.271317 13205 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:18.271828 13205 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:18.272624 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:01:18.272707 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:01:18.272764 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:18.273072 13205 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:18.296800 13205 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:18.296955 13205 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:18.297530 13205 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:18.298219 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:01:18.298707 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:01:18.298790 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:18.299027 13205 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:18.484100 13205 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:18.484272 13205 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:18.484824 13205 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:18.485648 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:01:18.485772 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:01:18.485900 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:18.486089 13205 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:18.532593 13357 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:18.532747 13357 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:18.533393 13357 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:18.534125 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:01:18.534436 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:01:18.534524 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:18.534713 13357 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:18.685369 13205 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:18.685539 13205 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:18.686046 13205 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:18.686764 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:01:18.686889 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:01:18.687227 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:18.687469 13205 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:19.110793 13415 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:19.111024 13415 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:19.111549 13415 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:19.112833 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:19.112987 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:01:19.113062 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:19.113245 13415 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:01:20.206303 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:01:20.206466 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:01:20.251614 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 6: this message will repeat every 5th retry.
I20260502 20:01:20.285741 13205 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:20.286003 13205 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:20.286481 13205 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:20.287297 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:01:20.287413 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:01:20.287511 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:20.287683 13205 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:20.295754 13205 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:20.295908 13205 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:20.296319 13205 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:20.297052 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:01:20.297223 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:01:20.297318 11209 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:20.297514 13205 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:20.339898 13205 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:20.340039 13205 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:20.340458 13205 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:20.341243 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:01:20.341359 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:01:20.341475 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:20.341635 13205 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:20.477263 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 6: this message will repeat every 5th retry.
W20260502 20:01:20.484351 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 6: this message will repeat every 5th retry.
W20260502 20:01:20.728458 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 6: this message will repeat every 5th retry.
I20260502 20:01:20.955618 13399 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:20.955740 13399 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:20.956219 13399 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:20.956912 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:01:20.957019 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:01:20.957104 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:20.957266 13399 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:21.290341 13442 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:21.290467 13442 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:21.291014 13442 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:21.291563 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111) [suppressed 7 similar messages]
W20260502 20:01:21.292281 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:21.292388 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:21.292466 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:21.292634 13442 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:01:21.518841 13357 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:21.519053 13357 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:21.519567 13357 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:21.520362 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:01:21.520489 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:01:21.520614 11206 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:21.520761 13357 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:21.837779 13399 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:21.837949 13399 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:21.838487 13399 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:21.839344 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:01:21.839434 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:01:21.839496 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:21.839632 13399 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:22.029500 13399 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:22.029642 13399 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:22.030136 13399 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:01:22.030886 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:01:22.031059 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:01:22.031198 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:22.031359 13399 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:22.255722 13205 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:22.255947 13205 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:22.256433 13205 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:22.257413 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:01:22.257537 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:01:22.257639 11206 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:22.257828 13205 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:22.650486 13462 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:22.650614 13462 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:22.651206 13462 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:22.652549 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:22.652649 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:01:22.652741 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:22.653050 13462 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:01:23.423244 13205 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:23.423414 13205 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:23.423916 13205 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:23.424683 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:01:23.424834 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:01:23.424921 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:23.425050 13205 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:23.642597 13357 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:23.642740 13357 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:23.643306 13357 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:01:23.643989 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:01:23.644078 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:01:23.644191 11209 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:23.644335 13357 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:23.722133 13357 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:23.722314 13357 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:23.722841 13357 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:23.723619 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:01:23.723722 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:01:23.723856 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:23.724031 13357 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:24.977054 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 11: this message will repeat every 5th retry.
I20260502 20:01:25.028297 13357 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:25.028468 13357 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:25.028942 13357 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:25.029776 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:01:25.029881 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:01:25.030006 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:25.030164 13357 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:25.207823 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:01:25.208009 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:01:25.400159 13357 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:25.400292 13357 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:25.400815 13357 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:25.401614 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:01:25.401717 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:01:25.401818 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:25.402053 13357 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:25.452523 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 11: this message will repeat every 5th retry.
W20260502 20:01:25.532488 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 11: this message will repeat every 5th retry.
I20260502 20:01:25.664208 13357 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:25.664352 13357 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:25.664878 13357 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:25.665654 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:01:25.665750 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:01:25.665839 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:25.666013 13357 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:25.973248 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 11: this message will repeat every 5th retry.
I20260502 20:01:26.075567 13503 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:26.075707 13503 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:26.076166 13503 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:26.077549 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:26.077646 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:01:26.077730 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:26.077894 13503 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:01:26.655051 13357 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:26.655184 13357 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:26.655581 13357 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:26.656275 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:01:26.656383 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:01:26.656481 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:26.656643 13357 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:26.702035 13357 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:26.702200 13357 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:26.702634 13357 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:26.703276 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:01:26.703392 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:01:26.703477 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:26.703673 13357 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:27.049568 13357 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:27.049719 13357 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:27.050272 13357 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:27.051136 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:01:27.051282 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:01:27.051369 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:27.051520 13357 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:30.081496 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 16: this message will repeat every 5th retry.
W20260502 20:01:30.139319 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 16: this message will repeat every 5th retry.
I20260502 20:01:30.209168 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:01:30.209303 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:01:30.557436 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 16: this message will repeat every 5th retry.
I20260502 20:01:30.695340 13559 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:30.695482 13559 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:30.695961 13559 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:30.696485 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260502 20:01:30.697350 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:30.697471 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:01:30.697562 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:30.697701 13559 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:01:31.029179 13205 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:31.029341 13205 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:31.029893 13205 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:31.030507 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:01:31.030611 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:01:31.030696 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:31.030826 13205 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:31.040696 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 16: this message will repeat every 5th retry.
I20260502 20:01:31.353005 13399 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:31.353195 13399 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:31.353608 13399 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:31.354429 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:01:31.354552 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:01:31.354635 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:31.354797 13399 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:32.305970 13399 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:32.306130 13399 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:32.306631 13399 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:01:32.307601 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:01:32.307695 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:01:32.307811 11209 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:32.308014 13399 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:32.396395 13579 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:32.396589 13579 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:32.397131 13579 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:32.398698 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:32.398783 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:32.398835 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:32.399001 13579 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:01:32.858659 13399 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:32.858911 13399 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:32.859452 13399 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:32.860384 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:01:32.860503 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:01:32.860574 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:32.860737 13399 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:33.028151 13399 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:33.028316 13399 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:33.028779 13399 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:33.029572 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:01:33.029707 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:01:33.029820 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:33.029976 13399 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:33.862412 13595 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:33.862571 13595 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:33.863142 13595 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:33.863904 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:01:33.863996 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:01:33.864037 11206 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:33.864287 13595 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:34.616751 13594 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:34.616886 13594 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:34.617246 13594 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:34.618014 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:01:34.618140 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:01:34.618242 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:34.618395 13594 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:35.211416 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:01:35.211534 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:01:35.350502 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 21: this message will repeat every 5th retry.
W20260502 20:01:35.733985 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 21: this message will repeat every 5th retry.
W20260502 20:01:35.752382 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 21: this message will repeat every 5th retry.
I20260502 20:01:36.108907 13631 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:36.109087 13631 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:36.109645 13631 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:36.110350 13226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 20:01:36.111382 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:36.111517 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:36.111635 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:36.111820 13631 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:01:36.263808 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 21: this message will repeat every 5th retry.
I20260502 20:01:36.295228 13621 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:36.295378 13621 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:36.296080 13621 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:01:36.296736 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:01:36.296836 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:01:36.296947 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:36.297138 13621 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:37.221643 13595 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:37.221786 13595 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:37.222292 13595 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:37.223069 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:01:37.223165 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:01:37.223343 11206 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:37.223506 13595 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:38.814633 13595 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:38.814785 13595 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:38.815471 13595 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:38.816258 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:01:38.816365 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:01:38.816469 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:38.816649 13595 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:39.699364 13675 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:39.699499 13675 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:39.699976 13675 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:39.701100 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:39.701241 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:01:39.701314 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:39.701443 13675 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:01:39.877578 13594 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:39.877811 13594 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:39.878301 13594 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:39.879114 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:01:39.879215 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:01:39.879304 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:39.879448 13594 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:40.213192 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:01:40.213353 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:01:40.217584 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 26: this message will repeat every 5th retry.
W20260502 20:01:40.269737 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 26: this message will repeat every 5th retry.
I20260502 20:01:40.509330 13594 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:40.509480 13594 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:40.510010 13594 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:40.510869 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:01:40.511351 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:01:40.511456 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:40.511637 13594 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:40.836916 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 26: this message will repeat every 5th retry.
W20260502 20:01:41.377960 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 26: this message will repeat every 5th retry.
I20260502 20:01:41.923414 13668 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:41.923559 13668 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:41.924104 13668 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:41.925024 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:01:41.925163 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:01:41.925259 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:41.925504 13668 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:43.046204 13713 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:43.046345 13713 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:43.046882 13713 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:43.047734 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:43.047734 13226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 20:01:43.048727 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:43.048805 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:43.048854 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:43.049022 13713 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:01:44.000344 13669 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:44.000496 13669 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:44.001073 13669 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:44.001971 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:01:44.002123 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:01:44.002274 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:44.002470 13669 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:44.541960 11320 heartbeater.cc:646] Failed to heartbeat to 127.10.27.190:46101 (304 consecutive failures): Network error: Failed to ping master at 127.10.27.190:46101: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:44.603449 11044 heartbeater.cc:646] Failed to heartbeat to 127.10.27.190:46101 (139 consecutive failures): Network error: Failed to ping master at 127.10.27.190:46101: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:44.603449 11045 heartbeater.cc:646] Failed to heartbeat to 127.10.27.189:46281 (64 consecutive failures): Network error: Failed to ping master at 127.10.27.189:46281: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:45.132958 11179 heartbeater.cc:646] Failed to heartbeat to 127.10.27.190:46101 (138 consecutive failures): Network error: Failed to ping master at 127.10.27.190:46101: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:45.214704 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:01:45.214834 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:01:45.323242 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 31: this message will repeat every 5th retry.
W20260502 20:01:45.324949 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 31: this message will repeat every 5th retry.
I20260502 20:01:45.811494 13669 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:45.811647 13669 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:45.812950 13669 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:01:45.813759 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:01:45.814043 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:01:45.814136 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:45.814459 13669 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:45.853194 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 31: this message will repeat every 5th retry.
W20260502 20:01:46.331544 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 31: this message will repeat every 5th retry.
I20260502 20:01:48.337081 13668 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:48.337257 13668 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:48.337785 13668 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:48.338680 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:01:48.338819 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:01:48.338936 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:48.339180 13668 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:49.750670 13669 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:49.750825 13669 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:49.751389 13669 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:49.751978 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:01:49.752269 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:01:49.752336 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:49.752523 13669 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:49.885334 13669 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:49.885560 13669 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:49.886343 13669 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:49.887245 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:01:49.887378 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:01:49.887544 11206 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:49.887794 13669 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:50.101372 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 36: this message will repeat every 5th retry.
I20260502 20:01:50.216171 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:01:50.216321 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:01:50.241055 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 36: this message will repeat every 5th retry.
I20260502 20:01:50.643327 13668 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:50.643479 13668 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:50.644021 13668 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:50.644932 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:01:50.645164 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:01:50.645234 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:50.645679 13668 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:50.801820 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 36: this message will repeat every 5th retry.
W20260502 20:01:51.392019 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 36: this message will repeat every 5th retry.
I20260502 20:01:51.448632 13744 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:51.448853 13744 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:51.449398 13744 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:51.450189 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:01:51.450358 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:01:51.450477 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:51.450714 13744 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:52.566198 13744 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:52.566365 13744 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:52.566831 13744 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:52.567744 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:01:52.567840 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:01:52.567956 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:52.568338 13744 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:53.975653 13669 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:53.975860 13669 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:53.976389 13669 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:53.977326 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:01:53.977519 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:01:53.977608 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:53.977869 13669 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:54.931635 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 41: this message will repeat every 5th retry.
I20260502 20:01:55.217411 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:01:55.217541 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:01:55.262780 13744 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:55.263132 13744 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:55.263666 13744 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:55.264612 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:01:55.264703 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:01:55.264808 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:55.264989 13744 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:01:55.304916 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 41: this message will repeat every 5th retry.
W20260502 20:01:55.739097 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 41: this message will repeat every 5th retry.
W20260502 20:01:56.831296 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 41: this message will repeat every 5th retry.
I20260502 20:01:57.053290 13874 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:01:57.053428 13874 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:01:57.053962 13874 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:01:57.054785 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:01:57.054785 13226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:57.055862 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:01:57.055948 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:01:57.056000 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:01:57.056186 13874 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:01:57.410364 13744 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:57.410522 13744 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:57.411131 13744 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:57.411959 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:01:57.412081 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:01:57.412194 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:57.412359 13744 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:57.635164 13744 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:57.635295 13744 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:57.635861 13744 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:57.636533 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:01:57.636632 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:01:57.636732 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:57.636955 13744 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:57.705502 13668 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:57.705650 13668 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:57.706132 13668 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:01:57.706662 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:01:57.707132 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:01:57.707207 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:57.707362 13668 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:58.025789 13744 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:01:58.025928 13744 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:01:58.026402 13744 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:58.027112 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:01:58.027200 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:01:58.027280 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:58.027437 13744 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:01:58.314329 13744 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:01:58.314540 13744 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:01:58.315131 13744 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:01:58.316018 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:01:58.316110 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:01:58.316220 11209 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:01:58.316401 13744 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:00.075395 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 46: this message will repeat every 5th retry.
I20260502 20:02:00.218631 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:02:00.218777 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:02:00.410732 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 46: this message will repeat every 5th retry.
W20260502 20:02:00.926807 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 46: this message will repeat every 5th retry.
I20260502 20:02:00.927906 13669 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:00.928031 13669 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:00.928627 13669 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:00.929383 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:02:00.929486 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:02:00.929602 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:00.929862 13669 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:01.541971 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 46: this message will repeat every 5th retry.
I20260502 20:02:01.570252 13744 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:01.570429 13744 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:01.570983 13744 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:01.571815 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:02:01.571928 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:02:01.572088 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:01.572250 13744 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:01.741214 13744 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:01.741391 13744 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:01.741858 13744 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:02:01.742699 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:02:01.742808 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:02:01.742964 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:01.743165 13744 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:02.650887 13744 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:02.651188 13744 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:02.651679 13744 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:02.652599 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:02:02.652705 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:02:02.652856 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:02.652992 13744 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:03.906695 13668 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:03.906875 13668 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:03.907485 13668 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:03.908175 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:02:03.908367 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:02:03.908458 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:03.908639 13668 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:04.654624 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 51: this message will repeat every 5th retry.
W20260502 20:02:05.205016 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 51: this message will repeat every 5th retry.
I20260502 20:02:05.220307 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:02:05.220450 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:02:05.813119 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 51: this message will repeat every 5th retry.
W20260502 20:02:06.798743 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 51: this message will repeat every 5th retry.
I20260502 20:02:06.859380 13669 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:06.859612 13669 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:06.860385 13669 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:06.861413 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:02:06.861526 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:02:06.861577 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:06.861730 13669 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:09.335001 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 56: this message will repeat every 5th retry.
I20260502 20:02:10.221818 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:02:10.221975 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:02:10.411950 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 56: this message will repeat every 5th retry.
W20260502 20:02:10.816398 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 56: this message will repeat every 5th retry.
I20260502 20:02:11.145601 13668 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:11.145817 13668 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:11.146270 13668 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:11.147032 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:02:11.147150 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:02:11.147269 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:11.147408 13668 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:11.995808 13668 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:11.995963 13668 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:11.996383 13668 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:11.997200 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:02:11.997339 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:02:11.997504 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:11.997715 13668 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:12.103658 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 56: this message will repeat every 5th retry.
I20260502 20:02:13.900106 13669 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:13.900264 13669 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:13.900810 13669 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:13.901664 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:02:13.901795 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:02:13.901921 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:13.902096 13669 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:14.396698 14078 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:02:14.396903 14078 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:02:14.397614 14078 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:02:14.398159 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:02:14.399101 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:02:14.399228 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:02:14.399322 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:02:14.399575 14078 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:02:14.601190 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 61: this message will repeat every 5th retry.
I20260502 20:02:15.223254 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:02:15.223402 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:02:15.378671 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 61: this message will repeat every 5th retry.
I20260502 20:02:15.447171 14065 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:15.447307 14065 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:15.447770 14065 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:15.448559 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:02:15.448652 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:02:15.448769 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:15.448911 14065 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:15.979629 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 61: this message will repeat every 5th retry.
I20260502 20:02:16.488291 14065 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:16.488493 14065 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:16.488983 14065 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:16.489890 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:02:16.490059 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:02:16.490123 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:16.490262 14065 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:16.926586 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 61: this message will repeat every 5th retry.
I20260502 20:02:17.748008 14065 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:17.748152 14065 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:17.748602 14065 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:17.749331 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:02:17.749425 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:02:17.749492 11209 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:17.749655 14065 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:18.134733 14066 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:18.134886 14066 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:18.135465 14066 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:18.136390 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:02:18.136538 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:02:18.136626 11206 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:18.136855 14066 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:19.221459 13669 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:19.221612 13669 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:19.222055 13669 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:19.223047 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:02:19.223150 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:02:19.223332 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:19.223559 13669 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:19.253672 14065 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:19.253844 14065 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:19.254300 14065 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:19.255214 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:02:19.255383 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:02:19.255461 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:19.255594 14065 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:19.688052 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 66: this message will repeat every 5th retry.
W20260502 20:02:20.077054 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 66: this message will repeat every 5th retry.
I20260502 20:02:20.224606 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:02:20.224784 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:02:21.138469 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 66: this message will repeat every 5th retry.
I20260502 20:02:21.243706 14065 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:21.243867 14065 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:21.244318 14065 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:02:21.245182 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:02:21.245306 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:02:21.245410 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:21.245600 14065 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:21.931810 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 66: this message will repeat every 5th retry.
I20260502 20:02:24.462862 13669 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:24.463038 13669 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:24.463557 13669 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:24.464322 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:02:24.464478 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:02:24.464565 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:24.464726 13669 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:24.676524 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 71: this message will repeat every 5th retry.
W20260502 20:02:24.996609 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 71: this message will repeat every 5th retry.
I20260502 20:02:25.226339 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:02:25.226505 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:02:26.044803 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 71: this message will repeat every 5th retry.
I20260502 20:02:26.365411 14215 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:02:26.365552 14215 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:02:26.365945 14215 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:02:26.366683 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 20:02:26.367653 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:02:26.367776 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:02:26.367882 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:02:26.368068 14215 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:02:27.081648 14065 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:27.081804 14065 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:27.082476 14065 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:27.083292 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:02:27.083393 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:02:27.083508 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:27.083726 14065 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:27.130020 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 71: this message will repeat every 5th retry.
I20260502 20:02:27.357353 13669 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:27.357534 13669 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:27.358105 13669 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:02:27.358837 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:02:27.358978 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:02:27.359066 11209 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:27.359292 13669 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:28.442039 13669 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:28.442198 13669 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:28.442747 13669 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:28.443682 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:02:28.443953 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:02:28.444063 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:28.444558 13669 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:29.038895 14066 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:29.039122 14066 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:29.039566 14066 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:29.040259 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:02:29.040346 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:02:29.040431 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:29.040562 14066 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:29.689402 14065 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:29.689538 14065 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:29.690039 14065 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:29.690672 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:02:29.690769 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:02:29.690884 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:29.691063 14065 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:29.991098 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 76: this message will repeat every 5th retry.
W20260502 20:02:30.144435 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 76: this message will repeat every 5th retry.
I20260502 20:02:30.227846 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:02:30.228061 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:02:30.950908 14273 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:02:30.951086 14273 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:02:30.951571 14273 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:02:30.953497 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:02:30.953712 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:02:30.953903 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:02:30.954171 14273 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:02:30.957828 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 76: this message will repeat every 5th retry.
W20260502 20:02:31.528004 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 76: this message will repeat every 5th retry.
I20260502 20:02:31.775863 14066 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:31.776036 14066 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:31.776623 14066 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:31.777488 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:02:31.777582 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:02:31.777697 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:31.777877 14066 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:33.023348 13669 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:33.023504 13669 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:33.023919 13669 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:33.024904 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:02:33.025067 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:02:33.025417 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:33.025727 13669 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:33.094045 13669 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:33.094182 13669 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:33.094697 13669 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:33.095479 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:02:33.095590 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:02:33.095693 11209 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:33.095837 13669 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:35.106012 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 81: this message will repeat every 5th retry.
I20260502 20:02:35.229103 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:02:35.229241 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:02:35.301785 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 81: this message will repeat every 5th retry.
I20260502 20:02:35.550324 13669 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:35.550505 13669 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:35.551028 13669 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:35.551807 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:02:35.551900 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:02:35.551999 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:35.552330 13669 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:36.034214 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 81: this message will repeat every 5th retry.
I20260502 20:02:36.340718 14066 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:36.340867 14066 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:36.341243 14066 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:36.341913 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:02:36.342003 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:02:36.342103 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:36.342284 14066 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:36.716362 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 81: this message will repeat every 5th retry.
I20260502 20:02:38.675347 14065 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:38.675565 14065 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:38.676020 14065 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:38.676980 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:02:38.677093 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:02:38.677157 11206 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:38.677354 14065 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:38.876385 14066 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:38.876566 14066 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:38.877086 14066 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:02:38.877915 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:02:38.878008 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:02:38.878082 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:38.878254 14066 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:39.054491 14065 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:39.054782 14065 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:39.055307 14065 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:39.056057 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:02:39.056178 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:02:39.056322 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:39.056552 14065 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:39.721066 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 86: this message will repeat every 5th retry.
I20260502 20:02:39.939016 14065 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:39.939220 14065 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:39.939898 14065 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:39.940730 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:02:39.940843 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:02:39.940968 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:39.941257 14065 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:40.192902 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 86: this message will repeat every 5th retry.
I20260502 20:02:40.230751 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:02:40.230876 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:02:41.081486 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 86: this message will repeat every 5th retry.
W20260502 20:02:41.400457 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 86: this message will repeat every 5th retry.
I20260502 20:02:43.303432 14066 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:43.303576 14066 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:43.304086 14066 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:43.304987 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:02:43.305088 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:02:43.305281 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:43.305521 14066 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:44.608542 11320 heartbeater.cc:646] Failed to heartbeat to 127.10.27.190:46101 (783 consecutive failures): Network error: Failed to ping master at 127.10.27.190:46101: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:02:44.746516 11044 heartbeater.cc:646] Failed to heartbeat to 127.10.27.190:46101 (259 consecutive failures): Network error: Failed to ping master at 127.10.27.190:46101: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:02:45.035300 13669 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:45.035495 13669 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:45.036015 13669 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:45.036868 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:02:45.037032 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:02:45.037134 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:45.037389 13669 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:45.217733 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 91: this message will repeat every 5th retry.
W20260502 20:02:45.230497 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 91: this message will repeat every 5th retry.
I20260502 20:02:45.231887 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:02:45.232010 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:02:45.274732 11180 heartbeater.cc:646] Failed to heartbeat to 127.10.27.189:46281 (186 consecutive failures): Network error: Failed to ping master at 127.10.27.189:46281: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:02:45.864177 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 91: this message will repeat every 5th retry.
W20260502 20:02:46.429030 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 91: this message will repeat every 5th retry.
I20260502 20:02:46.447992 14066 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:46.448150 14066 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:46.448647 14066 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:02:46.449524 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:02:46.449687 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:02:46.449780 11209 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:46.450026 14066 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:47.764405 14449 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:47.764576 14449 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:47.765020 14449 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:47.765724 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:02:47.765852 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:02:47.765951 11206 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:47.766110 14449 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:48.447193 14449 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:48.447369 14449 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:48.448021 14449 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:48.448987 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:02:48.449129 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:02:48.449185 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:48.449337 14449 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:48.936277 13669 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:48.936434 13669 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:48.936837 13669 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:48.938014 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:02:48.938107 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:02:48.938160 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:48.938293 13669 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:49.317221 14480 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:02:49.317354 14480 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:02:49.318001 14480 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:02:49.318773 13226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 20:02:49.319526 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:02:49.319854 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:02:49.319929 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:02:49.320088 14480 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:02:50.210642 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 96: this message will repeat every 5th retry.
I20260502 20:02:50.233255 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:02:50.233405 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:02:50.504302 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 96: this message will repeat every 5th retry.
I20260502 20:02:50.795612 14475 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:50.795822 14475 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:50.796289 14475 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:50.797081 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:02:50.797169 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:02:50.797278 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:50.797435 14475 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:51.095826 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 96: this message will repeat every 5th retry.
W20260502 20:02:51.593911 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 96: this message will repeat every 5th retry.
I20260502 20:02:51.609048 14505 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:02:51.609189 14505 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:02:51.609651 14505 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:02:51.611095 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:02:51.611196 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:02:51.611263 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:02:51.611407 14505 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:02:52.758333 14475 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:52.758507 14475 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:52.759097 14475 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:52.759918 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:02:52.760010 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:02:52.760078 11206 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:52.760263 14475 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:54.027894 14449 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:54.028113 14449 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:02:54.028759 14449 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:54.029611 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:02:54.029740 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:02:54.029865 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:54.030043 14449 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:02:55.234602 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:02:55.234758 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:02:55.308861 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 101: this message will repeat every 5th retry.
W20260502 20:02:55.464756 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 101: this message will repeat every 5th retry.
W20260502 20:02:56.105379 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 101: this message will repeat every 5th retry.
I20260502 20:02:56.236964 14449 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:02:56.237176 14449 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:56.237732 14449 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:56.238547 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:02:56.238724 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:02:56.238816 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:56.239048 14449 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:56.689023 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 101: this message will repeat every 5th retry.
I20260502 20:02:59.687165 14449 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:02:59.687330 14449 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:02:59.687813 14449 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:02:59.688922 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:02:59.689028 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:02:59.689087 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:02:59.689257 14449 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:02:59.850744 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 106: this message will repeat every 5th retry.
I20260502 20:03:00.032620 14581 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:00.032831 14581 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:00.033324 14581 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:00.034260 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:03:00.034533 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:03:00.034596 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:00.034821 14581 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:00.236317 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:03:00.236485 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:03:00.588881 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 106: this message will repeat every 5th retry.
W20260502 20:03:00.834364 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 106: this message will repeat every 5th retry.
W20260502 20:03:01.534492 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 106: this message will repeat every 5th retry.
I20260502 20:03:03.455559 14449 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:03.455729 14449 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:03.456233 14449 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:03.457051 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:03:03.457142 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:03:03.457249 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:03.457412 14449 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:03.733853 14475 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:03.734004 14475 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:03.734493 14475 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:03.735162 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:03:03.735313 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:03:03.735409 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:03.735566 14475 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:04.052778 14581 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:04.052949 14581 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:04.053515 14581 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:04.054352 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:03:04.054442 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:03:04.054561 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:04.054844 14581 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:04.306337 14449 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:04.306475 14449 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:04.307106 14449 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:03:04.307739 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:03:04.307852 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:03:04.307941 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:04.308110 14449 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:04.775200 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 111: this message will repeat every 5th retry.
I20260502 20:03:05.237936 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:03:05.238104 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:03:05.625389 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 111: this message will repeat every 5th retry.
W20260502 20:03:05.714728 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 111: this message will repeat every 5th retry.
I20260502 20:03:05.751407 14581 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:05.751629 14581 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:05.752223 14581 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:05.753137 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:03:05.753239 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:03:05.753309 11206 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:05.753470 14581 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:06.484810 14581 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:06.485051 14581 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:06.485546 14581 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:06.486171 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:03:06.486256 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:03:06.486315 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:06.486496 14581 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:06.614195 14676 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:03:06.614331 14676 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:03:06.615016 14676 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:03:06.615599 13226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 20:03:06.616321 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:03:06.616523 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:03:06.616624 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:03:06.616787 14676 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:03:06.710534 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 111: this message will repeat every 5th retry.
I20260502 20:03:07.221925 14581 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:07.222088 14581 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:07.222585 14581 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:07.223440 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:03:07.223579 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:03:07.223673 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:07.223954 14581 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:07.284138 14581 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:07.284278 14581 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:07.284785 14581 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:07.285499 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:03:07.285745 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:03:07.285836 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:07.286001 14581 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:08.532822 14581 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:08.533047 14581 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:08.533527 14581 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:08.534363 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:03:08.534477 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:03:08.534596 11206 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:08.534816 14581 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:08.922487 14581 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:08.922636 14581 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:08.923143 14581 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:08.923936 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:03:08.924032 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:03:08.924098 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:08.924270 14581 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:09.771165 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 116: this message will repeat every 5th retry.
I20260502 20:03:10.239296 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:03:10.239434 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:03:10.401932 14581 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:10.402086 14581 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:10.402617 14581 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:10.403517 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:03:10.403617 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:03:10.403688 11209 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:10.403832 14581 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:10.677634 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 116: this message will repeat every 5th retry.
W20260502 20:03:11.343461 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 116: this message will repeat every 5th retry.
W20260502 20:03:11.740008 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 116: this message will repeat every 5th retry.
I20260502 20:03:12.436746 14475 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:12.436918 14475 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:12.437486 14475 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:12.438364 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:03:12.438494 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:03:12.438597 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:12.438808 14475 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:12.934036 14475 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:12.934162 14475 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:12.934588 14475 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:12.935340 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:03:12.935508 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:03:12.935575 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:12.935691 14475 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:14.836946 14581 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:14.837098 14581 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:14.837638 14581 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:14.838603 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:03:14.838747 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:03:14.838837 11209 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:14.839128 14581 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:14.935289 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 121: this message will repeat every 5th retry.
I20260502 20:03:14.967150 14581 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:14.967299 14581 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:14.967746 14581 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:14.968601 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:03:14.968715 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:03:14.968801 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:14.968945 14581 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:15.240540 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:03:15.240692 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:03:15.247430 13231 maintenance_manager.cc:419] P b470a66ad54f46b1b44a80dd1edf214e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033348
I20260502 20:03:15.298727 13230 maintenance_manager.cc:643] P b470a66ad54f46b1b44a80dd1edf214e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.051s user 0.016s sys 0.004s Metrics: {"bytes_written":32265,"cfile_init":1,"dirs.queue_time_us":240,"dirs.run_cpu_time_us":241,"dirs.run_wall_time_us":1044,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":544,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":82,"thread_start_us":187,"threads_started":2,"wal-append.queue_time_us":277}
I20260502 20:03:15.299901 13231 maintenance_manager.cc:419] P b470a66ad54f46b1b44a80dd1edf214e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 5294 bytes on disk
I20260502 20:03:15.300639 13230 maintenance_manager.cc:643] P b470a66ad54f46b1b44a80dd1edf214e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":68,"lbm_reads_lt_1ms":4}
W20260502 20:03:15.772545 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 121: this message will repeat every 5th retry.
W20260502 20:03:16.443349 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 121: this message will repeat every 5th retry.
W20260502 20:03:16.548317 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 121: this message will repeat every 5th retry.
I20260502 20:03:16.604794 14475 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:16.604940 14475 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:16.605576 14475 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:16.606474 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:03:16.606586 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:03:16.606653 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:16.606822 14475 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:17.102342 14475 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:17.102519 14475 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:17.103029 14475 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:17.103768 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:03:17.103868 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:03:17.103981 11206 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:17.104169 14475 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:19.841127 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 126: this message will repeat every 5th retry.
I20260502 20:03:20.241966 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:03:20.242110 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:03:20.837805 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 126: this message will repeat every 5th retry.
W20260502 20:03:21.678319 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 126: this message will repeat every 5th retry.
W20260502 20:03:21.845173 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 126: this message will repeat every 5th retry.
I20260502 20:03:24.239440 14581 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:24.239630 14581 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:24.240213 14581 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:03:24.241066 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:03:24.241276 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:03:24.241351 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:24.241554 14581 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:24.688719 14890 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:03:24.688913 14890 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:03:24.689652 14890 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:03:24.690338 13226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 20:03:24.691152 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:03:24.691318 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:03:24.691416 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:03:24.691598 14890 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:03:24.872915 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 131: this message will repeat every 5th retry.
I20260502 20:03:25.243410 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:03:25.243575 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:03:25.826555 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 131: this message will repeat every 5th retry.
I20260502 20:03:26.159435 14475 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:26.159582 14475 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:26.160036 14475 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:26.160856 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:03:26.160992 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:03:26.161062 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:26.161257 14475 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:26.851470 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 131: this message will repeat every 5th retry.
W20260502 20:03:26.939370 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 131: this message will repeat every 5th retry.
I20260502 20:03:27.904724 14581 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:27.904889 14581 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:27.905719 14581 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:27.906519 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:03:27.906775 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:03:27.906867 11206 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:27.907141 14581 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:28.761723 14475 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:28.761926 14475 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:28.762595 14475 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:28.763374 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:03:28.763614 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:03:28.763685 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:28.763850 14475 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:29.003113 14475 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:29.003270 14475 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:29.003810 14475 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:29.004824 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:03:29.004932 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:03:29.005062 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:29.005344 14475 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:29.167948 14581 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:29.168118 14581 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:29.168867 14581 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:29.169864 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:03:29.170013 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:03:29.170127 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:29.170338 14581 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:29.188031 14962 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:03:29.188167 14962 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:03:29.188656 14962 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:03:29.190066 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:03:29.190465 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:03:29.190591 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:03:29.190766 14962 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:03:29.837284 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 136: this message will repeat every 5th retry.
I20260502 20:03:30.244915 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:03:30.245038 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:03:30.593914 14988 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:03:30.594056 14988 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:03:30.594632 14988 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:03:30.595453 13226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 20:03:30.596387 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:03:30.596629 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:03:30.596724 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:03:30.596863 14988 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:03:30.645978 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 136: this message will repeat every 5th retry.
I20260502 20:03:31.530457 14475 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:31.530624 14475 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:31.531139 14475 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:03:31.531867 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:03:31.532013 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:03:31.532092 11209 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:31.532243 14475 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:31.664872 14475 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:31.665041 14475 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:31.665494 14475 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:31.666316 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:03:31.666433 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:03:31.666524 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:31.666749 14475 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:31.864883 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 136: this message will repeat every 5th retry.
W20260502 20:03:31.957666 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 136: this message will repeat every 5th retry.
I20260502 20:03:34.094115 14475 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:34.094230 14475 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:34.094643 14475 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:34.095229 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:03:34.095312 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:03:34.095435 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:34.095584 14475 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:34.620812 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 141: this message will repeat every 5th retry.
I20260502 20:03:35.246208 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:03:35.246353 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:03:35.809940 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 141: this message will repeat every 5th retry.
I20260502 20:03:36.609004 14475 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:36.609150 14475 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:36.609586 14475 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:36.610167 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:03:36.610263 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:03:36.610366 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:36.610497 14475 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:37.190582 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 141: this message will repeat every 5th retry.
I20260502 20:03:37.224637 14475 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:37.224838 14475 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:37.225358 14475 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:03:37.225996 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:03:37.226107 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:03:37.226218 11209 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:37.226362 14475 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:37.743525 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 141: this message will repeat every 5th retry.
I20260502 20:03:37.970782 14475 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:37.970937 14475 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:37.971524 14475 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:37.972193 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:03:37.972308 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:03:37.972376 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:37.972530 14475 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:38.321537 15104 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:03:38.321815 15104 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:03:38.322611 15104 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:03:38.323206 13226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 20:03:38.324172 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:03:38.324282 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:03:38.324379 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:03:38.324528 15104 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:03:38.435844 14475 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:38.436059 14475 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:38.436589 14475 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:38.437433 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:03:38.437561 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:03:38.437695 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:38.437883 14475 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:39.098381 14449 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:39.098588 14449 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:39.099294 14449 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:39.100046 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:03:39.100288 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:03:39.100379 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:39.100548 14449 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:39.498602 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 146: this message will repeat every 5th retry.
I20260502 20:03:39.683656 14581 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:39.683835 14581 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:39.684636 14581 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:39.685382 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:03:39.685472 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:03:39.685619 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:39.685794 14581 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:40.247702 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:03:40.247860 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:03:40.863874 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 146: this message will repeat every 5th retry.
W20260502 20:03:41.863023 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 146: this message will repeat every 5th retry.
I20260502 20:03:42.308233 14475 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:42.308439 14475 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:42.308990 14475 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:42.310472 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:03:42.310761 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:03:42.310813 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:42.310997 14449 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:42.455933 14581 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:42.456079 14581 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:42.456837 14581 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:42.457674 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:03:42.457794 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:03:42.457898 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:42.458065 14581 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:42.810045 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 146: this message will repeat every 5th retry.
I20260502 20:03:43.266870 14449 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:43.267091 14449 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:43.267710 14449 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:43.268437 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:03:43.268573 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:03:43.268679 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:43.268970 14449 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:44.487558 14475 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:44.487696 14475 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:44.488184 14475 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:44.489114 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:03:44.489228 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:03:44.489331 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:44.489516 14475 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:44.503360 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 151: this message will repeat every 5th retry.
W20260502 20:03:44.798967 11320 heartbeater.cc:646] Failed to heartbeat to 127.10.27.190:46101 (1259 consecutive failures): Network error: Failed to ping master at 127.10.27.190:46101: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:03:44.885497 11044 heartbeater.cc:646] Failed to heartbeat to 127.10.27.190:46101 (379 consecutive failures): Network error: Failed to ping master at 127.10.27.190:46101: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:03:44.885497 11045 heartbeater.cc:646] Failed to heartbeat to 127.10.27.189:46281 (304 consecutive failures): Network error: Failed to ping master at 127.10.27.189:46281: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:03:45.048422 14581 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:45.048583 14581 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:45.049012 14581 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:45.049690 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:03:45.049787 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:03:45.049865 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:45.050019 14581 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:45.248896 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:03:45.249018 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:03:45.416322 11180 heartbeater.cc:646] Failed to heartbeat to 127.10.27.189:46281 (306 consecutive failures): Network error: Failed to ping master at 127.10.27.189:46281: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:03:45.430526 15217 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:03:45.430677 15217 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:03:45.431226 15217 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:03:45.431660 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 20:03:45.432507 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:03:45.433141 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:03:45.433215 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:03:45.433360 15217 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:03:45.456089 14475 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:45.456241 14475 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:45.456637 14475 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:03:45.457600 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:03:45.457701 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:03:45.457854 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:45.458037 14475 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:45.962498 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 151: this message will repeat every 5th retry.
W20260502 20:03:46.824222 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 151: this message will repeat every 5th retry.
I20260502 20:03:47.079648 14475 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:47.079810 14475 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:47.080243 14475 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:47.081270 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:03:47.081386 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:03:47.081450 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:47.081598 14475 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:47.682050 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 151: this message will repeat every 5th retry.
I20260502 20:03:49.317727 14449 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:49.317924 14449 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:49.318409 14449 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:49.319290 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:03:49.319392 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:03:49.319449 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:49.319598 14449 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:49.428323 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 156: this message will repeat every 5th retry.
I20260502 20:03:49.978883 14449 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:49.979069 14449 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:49.979512 14449 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:49.980355 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:03:49.980520 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:03:49.980608 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:49.980886 14449 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:50.250417 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:03:50.250566 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:03:50.739990 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 156: this message will repeat every 5th retry.
I20260502 20:03:51.096078 14581 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:51.096276 14581 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:51.096935 14581 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:51.097924 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:03:51.098053 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:03:51.098142 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:51.098338 14581 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:51.472014 14581 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:51.472178 14581 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:51.472827 14581 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:51.473616 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:03:51.473733 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:03:51.473796 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:51.473965 14581 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:51.876521 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 156: this message will repeat every 5th retry.
W20260502 20:03:52.516598 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 156: this message will repeat every 5th retry.
I20260502 20:03:52.518821 14475 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:52.518987 14475 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:52.519476 14475 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:52.520310 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:03:52.520612 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:03:52.520701 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:52.520987 14475 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:53.237572 14449 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:53.237764 14449 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:53.238170 14449 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:53.238838 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:03:53.238978 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:03:53.239073 11209 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:53.239240 14449 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:54.499454 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 161: this message will repeat every 5th retry.
I20260502 20:03:54.867559 14475 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:54.867704 14475 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:54.868145 14475 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:54.869125 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:03:54.869239 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:03:54.869309 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:54.869495 14475 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:55.251873 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:03:55.252007 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:03:56.050011 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 161: this message will repeat every 5th retry.
I20260502 20:03:56.987159 14581 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:56.987313 14581 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:56.987937 14581 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:56.988811 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:03:56.988932 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:03:56.989044 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:56.989271 14581 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:03:57.013963 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 161: this message will repeat every 5th retry.
W20260502 20:03:57.581208 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 161: this message will repeat every 5th retry.
I20260502 20:03:57.877013 14581 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:57.877173 14581 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:57.877619 14581 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:57.878342 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:03:57.878465 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:03:57.878564 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:57.878726 14581 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:58.554611 14581 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:03:58.554761 14581 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:03:58.555629 14581 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:03:58.556427 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:03:58.556528 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:03:58.556633 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:58.556800 14581 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:03:58.841028 15408 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:03:58.841183 15408 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:03:58.841845 15408 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:03:58.842518 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 20:03:58.843338 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:03:58.843462 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:03:58.843566 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:03:58.843750 15408 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:03:59.439182 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 166: this message will repeat every 5th retry.
I20260502 20:03:59.579855 14449 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:03:59.580031 14449 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:03:59.580524 14449 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:03:59.581349 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:03:59.581457 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:03:59.581575 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:03:59.581794 14449 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:00.133132 14581 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:00.133284 14581 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:00.134032 14581 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:00.135051 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:04:00.135397 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:04:00.135490 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:00.135721 14581 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:00.253867 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:04:00.254021 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:04:00.526139 14449 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:00.526530 14449 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:00.527276 14449 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:00.528475 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:04:00.528714 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:04:00.528821 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:00.529095 14449 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:00.838681 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 166: this message will repeat every 5th retry.
I20260502 20:04:01.455356 14449 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:01.455508 14449 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:01.455962 14449 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:01.456764 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:04:01.456979 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:04:01.457048 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:01.457190 14449 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:02.290572 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 166: this message will repeat every 5th retry.
W20260502 20:04:02.627323 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 166: this message will repeat every 5th retry.
I20260502 20:04:03.495630 14475 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:03.495805 14475 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:03.496472 14475 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:03.497452 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:04:03.497692 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:04:03.497797 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:03.497977 14475 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:04.073537 15492 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:04:04.073675 15492 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:04:04.074334 15492 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:04:04.074882 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 20:04:04.075680 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:04:04.075767 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:04:04.075851 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:04:04.076021 15492 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:04:04.210867 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 171: this message will repeat every 5th retry.
I20260502 20:04:04.824554 14475 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:04.824733 14475 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:04.825610 14475 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:04.826637 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:04:04.826751 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:04:04.826812 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:04.826987 14475 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:05.255568 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:04:05.255700 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:04:05.679350 14475 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:05.679512 14475 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:05.680128 14475 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:05.680994 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:04:05.681087 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:04:05.681206 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:05.681370 14475 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:06.151053 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 171: this message will repeat every 5th retry.
W20260502 20:04:07.177919 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 171: this message will repeat every 5th retry.
W20260502 20:04:07.884400 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 171: this message will repeat every 5th retry.
W20260502 20:04:09.052248 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 176: this message will repeat every 5th retry.
I20260502 20:04:09.305076 14449 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:09.305238 14449 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:09.305750 14449 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:09.306493 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:04:09.306625 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:04:09.306710 11206 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:09.306871 14449 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:09.352641 14449 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:09.352814 14449 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:09.353461 14449 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:09.354290 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:04:09.354398 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:04:09.354501 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:09.354658 14449 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:10.190582 15575 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:10.190804 15575 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:10.191406 15575 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:10.192284 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:04:10.192420 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:04:10.192525 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:10.192683 15575 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:10.256996 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:04:10.257179 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:04:10.577762 15575 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:10.577924 15575 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:10.578504 15575 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:04:10.579350 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:04:10.579609 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:04:10.579722 11209 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:10.579931 15575 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:10.821583 15575 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:10.821748 15575 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:10.822363 15575 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:10.823432 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:04:10.823541 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:04:10.823640 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:10.823807 15575 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:11.229866 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 176: this message will repeat every 5th retry.
I20260502 20:04:11.848672 14475 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:11.848867 14475 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:11.849568 14475 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:11.850719 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:04:11.850847 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:04:11.850910 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:11.851158 14475 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:12.052089 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 176: this message will repeat every 5th retry.
W20260502 20:04:12.670991 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 176: this message will repeat every 5th retry.
I20260502 20:04:13.489037 15611 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:13.489243 15611 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:13.489737 15611 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:13.490520 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:04:13.490705 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:04:13.490799 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:13.491031 15611 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:14.181376 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 181: this message will repeat every 5th retry.
I20260502 20:04:15.115984 15611 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:15.116144 15611 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:15.117033 15611 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:15.117825 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:04:15.117941 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:04:15.118052 11206 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:15.118320 15611 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:15.258607 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:04:15.258765 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:04:15.367274 15575 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:15.367501 15575 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:15.367978 15575 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:15.368722 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:04:15.368978 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:04:15.369050 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:15.369192 15575 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:16.056058 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 181: this message will repeat every 5th retry.
W20260502 20:04:16.921959 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 181: this message will repeat every 5th retry.
W20260502 20:04:17.429875 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 181: this message will repeat every 5th retry.
I20260502 20:04:18.155259 14449 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:18.155411 14449 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:18.155933 14449 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:18.156842 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:04:18.156926 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:04:18.156966 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:18.157135 14449 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:18.338609 14449 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:18.338810 14449 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:18.339309 14449 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:18.340257 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:04:18.340476 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:04:18.340587 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:18.340804 14449 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:19.236847 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 186: this message will repeat every 5th retry.
I20260502 20:04:19.449647 15713 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:04:19.449965 15713 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:04:19.450618 15713 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:04:19.451391 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 20:04:19.452291 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:04:19.452376 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:04:19.452463 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:04:19.452625 15713 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:04:19.657816 15611 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:19.658013 15611 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:19.658550 15611 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:19.659343 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:04:19.659528 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:04:19.659655 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:19.659861 15611 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:20.096840 15575 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:20.097043 15575 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:20.097592 15575 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:20.098474 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:04:20.098693 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:04:20.098806 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:20.098982 15575 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:20.260146 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:04:20.260293 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:04:21.106766 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 186: this message will repeat every 5th retry.
W20260502 20:04:22.108738 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 186: this message will repeat every 5th retry.
W20260502 20:04:22.434731 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 186: this message will repeat every 5th retry.
I20260502 20:04:23.171125 15775 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:04:23.171281 15775 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:04:23.171830 15775 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:04:23.173105 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:04:23.173218 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:04:23.173295 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:04:23.173516 15775 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:04:24.805399 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 191: this message will repeat every 5th retry.
I20260502 20:04:24.939214 14449 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:24.939368 14449 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:24.939800 14449 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:24.940603 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:04:24.940764 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:04:24.940872 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:24.941056 14449 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:25.261406 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:04:25.261581 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:04:25.480537 15575 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:25.480717 15575 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:25.481197 15575 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:25.482167 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:04:25.482287 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:04:25.482434 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:25.482606 15575 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:25.728320 15575 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:25.728471 15575 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:25.728904 15575 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:25.729600 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:04:25.729701 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:04:25.729812 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:25.729960 15575 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:26.252342 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 191: this message will repeat every 5th retry.
W20260502 20:04:27.120955 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 191: this message will repeat every 5th retry.
I20260502 20:04:27.624171 14449 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:27.624375 14449 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:27.624866 14449 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:27.625566 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:04:27.625698 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:04:27.625782 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:27.625931 14449 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:27.880946 14449 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:27.881098 14449 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:27.881568 14449 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:27.882366 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:04:27.882469 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:04:27.882611 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:27.882759 14449 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:27.885120 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 191: this message will repeat every 5th retry.
I20260502 20:04:29.681114 14449 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:29.681259 14449 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:29.681861 14449 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:04:29.682650 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:04:29.682854 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:04:29.682978 11209 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:29.683128 14449 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:29.766230 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 196: this message will repeat every 5th retry.
I20260502 20:04:30.262785 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:04:30.263017 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:04:30.458758 15575 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:30.458917 15575 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:30.459585 15575 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:30.460393 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:04:30.460532 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:04:30.460686 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:30.460990 15575 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:31.064688 14449 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:31.064858 14449 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:31.065311 14449 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:31.066119 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:04:31.066208 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:04:31.066298 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:31.066560 14449 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:31.473351 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 196: this message will repeat every 5th retry.
I20260502 20:04:32.028244 14449 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:32.028388 14449 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:32.028770 14449 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:32.029500 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:04:32.029623 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:04:32.029707 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:32.029865 14449 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:32.246181 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 196: this message will repeat every 5th retry.
W20260502 20:04:33.188163 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 196: this message will repeat every 5th retry.
W20260502 20:04:34.957791 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 201: this message will repeat every 5th retry.
I20260502 20:04:35.264305 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:04:35.264460 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:04:35.576936 15954 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:04:35.577139 15954 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:04:35.578393 15954 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:04:35.578483 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 20:04:35.579241 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:04:35.579573 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:04:35.579679 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:04:35.579849 15954 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:04:36.009761 15575 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:36.009914 15575 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:36.010390 15575 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:36.011196 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:04:36.011328 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:04:36.011440 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:36.011662 15575 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:36.497023 15611 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:36.497224 15611 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:36.497809 15611 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:04:36.498533 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:04:36.498631 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:04:36.498705 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:36.498922 15611 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:36.621781 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 201: this message will repeat every 5th retry.
W20260502 20:04:37.447645 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 201: this message will repeat every 5th retry.
W20260502 20:04:37.511291 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 201: this message will repeat every 5th retry.
I20260502 20:04:37.994905 15611 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:37.995281 15611 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:37.995826 15611 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:37.997037 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:04:37.997583 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:04:37.997642 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:37.997793 15575 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:39.934008 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 206: this message will repeat every 5th retry.
I20260502 20:04:40.267040 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:04:40.267239 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:04:41.155094 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 206: this message will repeat every 5th retry.
W20260502 20:04:42.371940 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 206: this message will repeat every 5th retry.
W20260502 20:04:42.409832 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 206: this message will repeat every 5th retry.
I20260502 20:04:42.945945 15611 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:42.946098 15611 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:42.946925 15611 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:42.947758 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:04:42.947904 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:04:42.947996 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:42.948148 15611 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:42.989634 15611 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:42.989792 15611 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:42.990356 15611 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:42.991196 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:04:42.991300 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:04:42.991349 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:42.991504 15611 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:43.350837 16061 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:43.351001 16061 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:43.351364 16061 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:43.352185 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:04:43.352301 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:04:43.352421 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:43.352629 16061 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:43.980451 16061 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:43.980598 16061 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:43.981168 16061 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:43.981720 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:04:43.981823 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:04:43.981920 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:43.982064 16061 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:44.431306 15575 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:44.431438 15575 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:44.431842 15575 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:44.432637 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:04:44.432806 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:04:44.432920 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:44.433090 15575 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:44.695452 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 211: this message will repeat every 5th retry.
W20260502 20:04:45.027851 11044 heartbeater.cc:646] Failed to heartbeat to 127.10.27.190:46101 (499 consecutive failures): Network error: Failed to ping master at 127.10.27.190:46101: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:04:45.107431 11321 heartbeater.cc:646] Failed to heartbeat to 127.10.27.189:46281 (1674 consecutive failures): Network error: Failed to ping master at 127.10.27.189:46281: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:04:45.268482 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:04:45.268728 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:04:45.556036 11180 heartbeater.cc:646] Failed to heartbeat to 127.10.27.189:46281 (426 consecutive failures): Network error: Failed to ping master at 127.10.27.189:46281: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:04:46.131855 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 211: this message will repeat every 5th retry.
W20260502 20:04:46.976784 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 211: this message will repeat every 5th retry.
W20260502 20:04:47.027534 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 211: this message will repeat every 5th retry.
W20260502 20:04:49.621964 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 216: this message will repeat every 5th retry.
I20260502 20:04:50.269826 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:04:50.270013 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:04:51.016659 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 216: this message will repeat every 5th retry.
I20260502 20:04:51.204057 15575 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:51.204202 15575 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:51.204763 15575 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:51.205550 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:04:51.205636 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:04:51.205745 11209 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:51.205883 15575 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:52.188483 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 216: this message will repeat every 5th retry.
W20260502 20:04:52.231252 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 216: this message will repeat every 5th retry.
I20260502 20:04:52.628798 16061 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:52.628934 16061 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:52.629492 16061 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:52.630100 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:04:52.630257 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:04:52.630308 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:52.630484 16061 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:52.812666 16168 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:52.812824 16168 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:52.813380 16168 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:04:52.814177 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:04:52.814284 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:04:52.814349 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:52.814507 16168 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:53.139647 15575 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:53.139825 15575 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:53.140393 15575 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:53.141124 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:04:53.141397 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:04:53.141470 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:53.141669 15575 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:54.069350 16218 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:04:54.069491 16218 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:04:54.070596 16218 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:04:54.071295 13226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 20:04:54.072258 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:04:54.072358 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:04:54.072413 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:04:54.072576 16218 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:04:54.360203 16215 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:54.360378 16215 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:54.360826 16215 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:54.361778 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:04:54.361882 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:04:54.361938 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:54.362149 16215 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:54.531571 16215 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:54.531709 16215 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:54.532189 16215 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:54.532860 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:04:54.532980 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:04:54.533103 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:54.533314 16215 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:54.777832 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 221: this message will repeat every 5th retry.
I20260502 20:04:54.971737 16061 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:54.971957 16061 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:54.972419 16061 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:54.973261 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:04:54.973356 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:04:54.973425 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:54.973603 16061 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:55.271308 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:04:55.271487 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:04:56.175987 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 221: this message will repeat every 5th retry.
W20260502 20:04:56.888343 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 221: this message will repeat every 5th retry.
W20260502 20:04:57.002441 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 221: this message will repeat every 5th retry.
I20260502 20:04:57.323114 16215 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:57.323263 16215 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:04:57.323696 16215 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:57.324592 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:04:57.324687 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:04:57.324779 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:57.324950 16215 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:59.160890 16168 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:04:59.161041 16168 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:59.161461 16168 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:59.162431 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:04:59.162582 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:04:59.162700 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:59.163081 16168 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:04:59.692258 16215 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:04:59.692416 16215 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:04:59.692811 16215 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:04:59.693866 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:04:59.693991 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:04:59.694108 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:04:59.694348 16215 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:04:59.906442 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 226: this message will repeat every 5th retry.
I20260502 20:05:00.272720 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:05:00.272871 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:05:01.243700 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 226: this message will repeat every 5th retry.
W20260502 20:05:02.149909 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 226: this message will repeat every 5th retry.
I20260502 20:05:02.408190 16168 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:02.408358 16168 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:02.408932 16168 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:02.409853 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:05:02.409968 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:05:02.410085 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:02.410266 16168 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:02.432694 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 226: this message will repeat every 5th retry.
I20260502 20:05:02.462431 16061 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:02.462595 16061 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:02.463065 16061 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:05:02.464002 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:05:02.464201 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:05:02.464391 11209 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:02.464556 16061 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:02.556037 16215 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:02.556231 16215 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:02.556658 16215 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:02.557304 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:05:02.557581 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:05:02.557659 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:02.557848 16215 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:04.668294 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 231: this message will repeat every 5th retry.
I20260502 20:05:05.274127 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:05:05.274284 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:05:06.048454 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 231: this message will repeat every 5th retry.
I20260502 20:05:06.489518 16215 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:06.489665 16215 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:06.490259 16215 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:06.491050 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:05:06.491257 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:05:06.491303 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:06.491431 16215 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:06.986270 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 231: this message will repeat every 5th retry.
I20260502 20:05:07.103086 16215 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:07.103219 16215 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:07.103616 16215 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:07.104386 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:05:07.104620 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:05:07.104698 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:07.104840 16215 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:07.169382 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 231: this message will repeat every 5th retry.
I20260502 20:05:08.514576 16423 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:05:08.514730 16423 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:05:08.515267 16423 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:05:08.515926 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 20:05:08.517025 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:05:08.517232 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:05:08.517459 13227 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:05:08.517704 16423 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:05:09.694015 16061 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:09.694169 16061 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:09.694634 16061 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:09.695315 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:05:09.695451 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:05:09.695528 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:09.695701 16061 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:09.817279 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 236: this message will repeat every 5th retry.
I20260502 20:05:10.275861 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:05:10.276130 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:05:10.672323 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 236: this message will repeat every 5th retry.
I20260502 20:05:11.272585 16168 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:11.272738 16168 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:11.273196 16168 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:11.273976 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:05:11.274072 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:05:11.274137 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:11.274312 16168 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:11.521647 16168 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:11.521797 16168 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:11.522408 16168 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:11.523334 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:05:11.523460 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:05:11.523602 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:11.523758 16168 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:11.924737 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 236: this message will repeat every 5th retry.
W20260502 20:05:12.310775 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 236: this message will repeat every 5th retry.
I20260502 20:05:13.940613 16168 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:13.940768 16168 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:13.941301 16168 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:13.942128 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:05:13.942242 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:05:13.942314 11206 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:13.942462 16168 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:14.367182 16061 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:14.367333 16061 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:14.367714 16061 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:14.368608 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:05:14.368703 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:05:14.368774 11206 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:14.368935 16061 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:14.484083 16061 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:14.484242 16061 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:14.484755 16061 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:05:14.485617 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:05:14.485714 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:05:14.485821 11209 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:14.486027 16061 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:14.913726 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 241: this message will repeat every 5th retry.
I20260502 20:05:15.277417 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:05:15.277560 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:05:15.955142 16061 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:15.955268 16061 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:15.955713 16061 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:15.956398 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:05:15.956487 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:05:15.956604 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:15.956935 16061 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:16.053097 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 241: this message will repeat every 5th retry.
W20260502 20:05:17.293418 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 241: this message will repeat every 5th retry.
I20260502 20:05:17.409956 16168 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:17.410101 16168 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:17.410533 16168 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:05:17.411623 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:05:17.411862 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:05:17.411962 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:17.412279 16168 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:17.584235 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 241: this message will repeat every 5th retry.
I20260502 20:05:18.597213 16061 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:18.597453 16061 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:18.597967 16061 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:18.598649 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:05:18.599184 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:05:18.599253 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:18.599411 16061 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:19.174739 16168 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:19.174893 16168 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:19.175797 16168 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:19.176616 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:05:19.176795 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:05:19.176887 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:19.177099 16168 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:19.614758 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 246: this message will repeat every 5th retry.
I20260502 20:05:19.886286 16168 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:19.886531 16168 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:19.887001 16168 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:19.888053 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:05:19.888181 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:05:19.888242 11206 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:19.888527 16168 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:19.989210 16168 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:19.989395 16168 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:19.989920 16168 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:19.990615 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:05:19.990711 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:05:19.990814 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:19.990984 16168 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:20.279458 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:05:20.279680 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:05:20.326164 16061 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:20.326323 16061 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:20.326845 16061 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:20.327723 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:05:20.327858 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:05:20.327994 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:20.328258 16061 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:21.002974 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 246: this message will repeat every 5th retry.
W20260502 20:05:22.331176 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 246: this message will repeat every 5th retry.
W20260502 20:05:22.585036 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 246: this message will repeat every 5th retry.
I20260502 20:05:24.472599 16168 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:24.472857 16168 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:24.473475 16168 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:24.474315 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:05:24.474543 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:05:24.474624 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:24.474844 16168 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:24.921689 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 251: this message will repeat every 5th retry.
I20260502 20:05:25.280755 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:05:25.280910 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:05:25.943501 16061 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:25.943704 16061 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:25.944190 16061 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:25.945112 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:05:25.945266 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:05:25.945326 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:25.945555 16061 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:26.365814 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 251: this message will repeat every 5th retry.
I20260502 20:05:27.027246 16682 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:05:27.027424 16682 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:05:27.027980 16682 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:05:27.028729 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 20:05:27.029636 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:05:27.029789 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:05:27.029851 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:05:27.029973 16682 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:05:27.417016 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 251: this message will repeat every 5th retry.
W20260502 20:05:27.783696 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 251: this message will repeat every 5th retry.
I20260502 20:05:28.775341 16215 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:28.775626 16215 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:28.776162 16215 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:28.777019 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:05:28.777117 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:05:28.777206 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:28.777419 16215 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:29.496534 16720 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:05:29.496701 16720 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:05:29.497439 16720 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:05:29.498683 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:05:29.498821 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:05:29.498919 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:05:29.499253 16720 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:05:29.623009 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 256: this message will repeat every 5th retry.
I20260502 20:05:30.100852 16215 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:30.101045 16215 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:30.101567 16215 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:30.102340 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:05:30.102429 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:05:30.102535 11209 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:30.102677 16215 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:30.282305 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:05:30.282469 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:05:31.266996 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 256: this message will repeat every 5th retry.
I20260502 20:05:31.336119 16215 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:31.336284 16215 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:31.336879 16215 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:31.337839 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:05:31.337949 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:05:31.338061 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:31.338227 16215 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:31.366257 16215 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:31.366410 16215 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:31.366910 16215 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:31.367877 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:05:31.367985 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:05:31.368041 11206 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:31.368181 16215 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:31.868527 16215 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:31.868680 16215 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:31.869149 16215 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:05:31.870301 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:05:31.870601 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:05:31.870693 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:31.870908 16215 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:32.475967 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 256: this message will repeat every 5th retry.
W20260502 20:05:32.600574 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 256: this message will repeat every 5th retry.
I20260502 20:05:32.769044 16168 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:32.769349 16168 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:32.769927 16168 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:32.770751 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:05:32.770879 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:05:32.770994 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:32.771209 16168 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:33.196542 16168 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:33.196713 16168 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:33.197235 16168 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:33.198204 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:05:33.198338 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:05:33.198431 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:33.198599 16168 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:34.485061 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 261: this message will repeat every 5th retry.
I20260502 20:05:35.283671 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:05:35.283818 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:05:35.788421 16215 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:35.788597 16215 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:35.789052 16215 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:35.789894 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:05:35.789981 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:05:35.790082 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:35.790288 16215 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:36.545967 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 261: this message will repeat every 5th retry.
I20260502 20:05:36.590334 16061 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:36.590546 16061 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:36.591042 16061 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:36.591941 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:05:36.592129 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:05:36.592185 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:36.592310 16061 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:37.314419 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 261: this message will repeat every 5th retry.
W20260502 20:05:37.427707 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 261: this message will repeat every 5th retry.
I20260502 20:05:37.447577 16168 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:37.447731 16168 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:37.448216 16168 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:37.448983 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:05:37.449100 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:05:37.449210 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:37.449395 16168 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:37.486899 16168 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:37.487078 16168 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:37.487594 16168 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:37.488309 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:05:37.488410 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:05:37.488523 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:37.488715 16168 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:39.493093 16215 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:39.493247 16215 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:39.493799 16215 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:39.494521 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:05:39.494622 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:05:39.494726 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:39.494900 16215 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:39.755386 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 266: this message will repeat every 5th retry.
I20260502 20:05:40.284950 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:05:40.285089 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:05:41.236865 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 266: this message will repeat every 5th retry.
W20260502 20:05:42.090076 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 266: this message will repeat every 5th retry.
W20260502 20:05:42.577023 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 266: this message will repeat every 5th retry.
I20260502 20:05:43.068506 16215 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:43.068712 16215 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:43.069286 16215 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:43.070151 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:05:43.070334 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:05:43.070451 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:43.070621 16215 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:43.276194 16168 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:43.276331 16168 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:43.276912 16168 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:43.277715 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:05:43.277866 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:05:43.277962 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:43.278174 16168 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:44.140137 16915 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:05:44.140297 16915 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:05:44.140885 16915 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:05:44.141551 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 20:05:44.142287 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:05:44.142544 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:05:44.142656 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:05:44.142849 16915 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:05:44.710114 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 271: this message will repeat every 5th retry.
I20260502 20:05:44.979910 16215 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:44.980063 16215 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:44.980602 16215 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:44.981496 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:05:44.981606 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:05:44.981760 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:44.981947 16215 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:45.170367 11044 heartbeater.cc:646] Failed to heartbeat to 127.10.27.190:46101 (619 consecutive failures): Network error: Failed to ping master at 127.10.27.190:46101: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:05:45.211956 11321 heartbeater.cc:646] Failed to heartbeat to 127.10.27.189:46281 (2153 consecutive failures): Network error: Failed to ping master at 127.10.27.189:46281: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:05:45.286162 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:05:45.286302 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:05:45.673317 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 271: this message will repeat every 5th retry.
W20260502 20:05:45.700531 11179 heartbeater.cc:646] Failed to heartbeat to 127.10.27.190:46101 (618 consecutive failures): Network error: Failed to ping master at 127.10.27.190:46101: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
I20260502 20:05:45.938314 16061 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:45.938546 16061 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:45.939016 16061 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:45.939913 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:05:45.940013 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:05:45.940070 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:45.940258 16061 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:46.111513 16948 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:05:46.111658 16948 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:05:46.112092 16948 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:05:46.113706 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:05:46.113823 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:05:46.113889 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:05:46.114017 16948 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:05:47.499176 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 271: this message will repeat every 5th retry.
W20260502 20:05:47.522567 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 271: this message will repeat every 5th retry.
I20260502 20:05:47.564255 16972 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:47.564426 16972 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:47.564965 16972 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:47.565761 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:05:47.565853 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:05:47.565936 11209 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:47.566076 16972 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:49.652976 17000 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:05:49.653131 17000 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:05:49.653633 17000 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:05:49.654206 13226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 20:05:49.655035 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:05:49.655128 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:05:49.655205 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:05:49.655381 17000 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 20:05:50.287834 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:05:50.288013 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:05:50.288344 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 276: this message will repeat every 5th retry.
I20260502 20:05:50.360347 16168 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:50.360612 16168 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:50.361129 16168 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:05:50.361966 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:05:50.362107 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:05:50.362195 11209 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:50.362386 16168 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:50.578653 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 276: this message will repeat every 5th retry.
I20260502 20:05:50.810910 16168 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:50.811129 16168 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:50.811609 16168 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:50.812434 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:05:50.812518 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:05:50.812574 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:50.812788 16168 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:52.268951 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 276: this message will repeat every 5th retry.
W20260502 20:05:52.333344 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 276: this message will repeat every 5th retry.
I20260502 20:05:53.112941 16971 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:53.113216 16971 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:53.113852 16971 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:05:53.114600 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:05:53.114724 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:05:53.114832 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:53.115121 16971 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:53.642508 16972 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:53.642652 16972 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:53.643204 16972 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:53.643939 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:05:53.644023 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:05:53.644083 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:53.644212 16972 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:54.639612 16971 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:54.639781 16971 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:54.640352 16971 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:54.641124 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:05:54.641227 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:05:54.641288 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:54.641422 16971 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:05:55.289505 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:05:55.289695 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:05:55.428993 16971 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:55.429144 16971 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:55.429759 16971 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:55.430581 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:05:55.430675 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:05:55.430744 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:55.430915 16971 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:55.472481 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 281: this message will repeat every 5th retry.
W20260502 20:05:55.734301 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 281: this message will repeat every 5th retry.
I20260502 20:05:57.278914 16971 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:05:57.279138 16971 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:05:57.279639 16971 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:57.280375 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:05:57.280481 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:05:57.280591 11206 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:57.280756 16971 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:05:57.599756 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 281: this message will repeat every 5th retry.
W20260502 20:05:57.625982 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 281: this message will repeat every 5th retry.
I20260502 20:05:58.947086 16971 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:05:58.947240 16971 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:05:58.947793 16971 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:05:58.948508 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:05:58.948627 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:05:58.948686 11206 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:05:58.948890 16971 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:06:00.290982 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:06:00.291123 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:06:00.581722 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 286: this message will repeat every 5th retry.
W20260502 20:06:00.640668 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 286: this message will repeat every 5th retry.
I20260502 20:06:01.026085 16972 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:06:01.026475 16972 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:06:01.027024 16972 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:06:01.027745 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:06:01.027848 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:06:01.027966 11206 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:06:01.028126 16972 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:06:01.037644 16972 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:06:01.037868 16972 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:06:01.038435 16972 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:06:01.039389 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:06:01.039549 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:06:01.039680 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:06:01.039969 16972 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:06:01.507298 16972 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:06:01.507447 16972 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:06:01.507936 16972 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:06:01.508668 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:06:01.508757 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:06:01.508893 11209 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:06:01.509161 16972 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:06:02.557288 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 286: this message will repeat every 5th retry.
W20260502 20:06:03.043119 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 286: this message will repeat every 5th retry.
W20260502 20:06:05.218973 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 291: this message will repeat every 5th retry.
I20260502 20:06:05.292606 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:06:05.292793 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:06:05.324522 16168 raft_consensus.cc:493] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:06:05.324666 16168 raft_consensus.cc:515] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:06:05.325107 16168 leader_election.cc:290] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:06:05.326012 11209 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
W20260502 20:06:05.326117 11206 leader_election.cc:343] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 9df3ebd756b248d0b92bad3259e7a122
I20260502 20:06:05.326195 11206 leader_election.cc:304] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:06:05.326504 16168 raft_consensus.cc:2749] T 9df3ebd756b248d0b92bad3259e7a122 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:06:05.461592 17220 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:06:05.461746 17220 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:06:05.462430 17220 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:06:05.463136 13227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 20:06:05.464334 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:06:05.464432 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:06:05.464486 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:06:05.464633 17220 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:06:05.812175 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 291: this message will repeat every 5th retry.
I20260502 20:06:06.580200 16168 raft_consensus.cc:493] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:06:06.580338 16168 raft_consensus.cc:515] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:06:06.580765 16168 leader_election.cc:290] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:06:06.581732 11209 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
W20260502 20:06:06.582018 11206 leader_election.cc:343] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 26352d15574149da915d302b3a322a46
I20260502 20:06:06.582237 11206 leader_election.cc:304] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:06:06.582494 16168 raft_consensus.cc:2749] T 26352d15574149da915d302b3a322a46 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:06:07.080474 16971 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:06:07.080686 16971 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:06:07.081339 16971 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:06:07.082125 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:06:07.082240 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:06:07.082337 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:06:07.082482 16971 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:06:07.280900 16168 raft_consensus.cc:493] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:06:07.281054 16168 raft_consensus.cc:515] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:06:07.281569 16168 leader_election.cc:290] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:06:07.282419 11206 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
W20260502 20:06:07.282608 11209 leader_election.cc:343] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: af5837b307bb43258aa75c9a947dd5c6
I20260502 20:06:07.282712 11209 leader_election.cc:304] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:06:07.282886 16168 raft_consensus.cc:2749] T af5837b307bb43258aa75c9a947dd5c6 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:06:07.436403 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 291: this message will repeat every 5th retry.
W20260502 20:06:08.259637 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 291: this message will repeat every 5th retry.
W20260502 20:06:09.978665 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 296: this message will repeat every 5th retry.
I20260502 20:06:10.294019 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:06:10.294157 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 20:06:11.106458 11209 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 296: this message will repeat every 5th retry.
I20260502 20:06:11.223359 16971 raft_consensus.cc:493] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:06:11.223481 16971 raft_consensus.cc:515] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:06:11.224087 16971 leader_election.cc:290] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285), 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793)
W20260502 20:06:11.224767 11209 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
W20260502 20:06:11.224875 11206 leader_election.cc:343] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 7d4b56bf7bac4ec7840e05107fd49caa
I20260502 20:06:11.224977 11206 leader_election.cc:304] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:06:11.225196 16971 raft_consensus.cc:2749] T 7d4b56bf7bac4ec7840e05107fd49caa P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:06:12.351939 17289 raft_consensus.cc:493] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:06:12.352121 17289 raft_consensus.cc:515] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:06:12.352547 17289 leader_election.cc:290] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:06:12.353353 11206 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
W20260502 20:06:12.353559 11209 leader_election.cc:343] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 3cdb6695c99e4da682e33b146b0e51ab
I20260502 20:06:12.353660 11209 leader_election.cc:304] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:06:12.353911 17289 raft_consensus.cc:2749] T 3cdb6695c99e4da682e33b146b0e51ab P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:06:12.491168 17289 raft_consensus.cc:493] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:06:12.491318 17289 raft_consensus.cc:515] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } } peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } }
I20260502 20:06:12.491837 17289 leader_election.cc:290] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:06:12.492676 11209 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
W20260502 20:06:12.492834 11206 leader_election.cc:343] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 5af60ba1c00442a798b20b2470f9216a
I20260502 20:06:12.492908 11206 leader_election.cc:304] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:06:12.493170 17289 raft_consensus.cc:2749] T 5af60ba1c00442a798b20b2470f9216a P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:06:12.715143 11206 consensus_peers.cc:597] T c3ab3bbc37b94d6f97081c8fd069749a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ab3bbc37b94d6f97081c8fd069749a. This is attempt 296: this message will repeat every 5th retry.
I20260502 20:06:13.062177 17322 raft_consensus.cc:493] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef9294b460014382a2a594c77f8900d4)
I20260502 20:06:13.062393 17322 raft_consensus.cc:515] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38315e4f56484666b5e54afad02498ec" member_type: VOTER last_known_addr { host: "127.10.27.190" port: 46101 } } peers { permanent_uuid: "ef9294b460014382a2a594c77f8900d4" member_type: VOTER last_known_addr { host: "127.10.27.189" port: 46281 } } peers { permanent_uuid: "b470a66ad54f46b1b44a80dd1edf214e" member_type: VOTER last_known_addr { host: "127.10.27.188" port: 33369 } }
I20260502 20:06:13.062985 17322 leader_election.cc:290] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101), ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281)
W20260502 20:06:13.063828 13226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 20:06:13.064622 13227 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 38315e4f56484666b5e54afad02498ec (127.10.27.190:46101): Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111)
W20260502 20:06:13.064747 13226 leader_election.cc:336] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef9294b460014382a2a594c77f8900d4 (127.10.27.189:46281): Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
I20260502 20:06:13.064812 13226 leader_election.cc:304] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b470a66ad54f46b1b44a80dd1edf214e; no voters: 38315e4f56484666b5e54afad02498ec, ef9294b460014382a2a594c77f8900d4
I20260502 20:06:13.065107 17322 raft_consensus.cc:2749] T 00000000000000000000000000000000 P b470a66ad54f46b1b44a80dd1edf214e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 20:06:13.081970 11206 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Couldn't send request to peer 858db0bc9f07476e9d1540f2b095414f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 296: this message will repeat every 5th retry.
I20260502 20:06:13.635669 16971 raft_consensus.cc:493] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b85d150f168f406bb31ff44150b2b1a1)
I20260502 20:06:13.635804 16971 raft_consensus.cc:515] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:06:13.636319 16971 leader_election.cc:290] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:06:13.637156 11206 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
W20260502 20:06:13.637247 11209 leader_election.cc:343] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: faafd4c8dd3a4e2ebea018657480f840
I20260502 20:06:13.637312 11209 leader_election.cc:304] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:06:13.637457 16971 raft_consensus.cc:2749] T faafd4c8dd3a4e2ebea018657480f840 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 20:06:15.044903 16168 raft_consensus.cc:493] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 858db0bc9f07476e9d1540f2b095414f)
I20260502 20:06:15.045079 16168 raft_consensus.cc:515] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "858db0bc9f07476e9d1540f2b095414f" member_type: VOTER last_known_addr { host: "127.10.27.129" port: 36793 } } peers { permanent_uuid: "b85d150f168f406bb31ff44150b2b1a1" member_type: VOTER last_known_addr { host: "127.10.27.130" port: 43285 } } peers { permanent_uuid: "ade741c4062940adb2223b55187ffe72" member_type: VOTER last_known_addr { host: "127.10.27.131" port: 43389 } }
I20260502 20:06:15.045501 16168 leader_election.cc:290] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793), b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285)
W20260502 20:06:15.046339 11206 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 858db0bc9f07476e9d1540f2b095414f (127.10.27.129:36793): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
W20260502 20:06:15.046458 11209 leader_election.cc:343] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Not found: Tablet not found: 0ea263d32fd2405985d4514c2ff02a39
I20260502 20:06:15.046552 11209 leader_election.cc:304] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade741c4062940adb2223b55187ffe72; no voters: 858db0bc9f07476e9d1540f2b095414f, b85d150f168f406bb31ff44150b2b1a1
I20260502 20:06:15.046964 16168 raft_consensus.cc:2749] T 0ea263d32fd2405985d4514c2ff02a39 P ade741c4062940adb2223b55187ffe72 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 20:06:15.096698 11209 consensus_peers.cc:597] T 218dfac06cf841c6aced6781154f283a P ade741c4062940adb2223b55187ffe72 -> Peer b85d150f168f406bb31ff44150b2b1a1 (127.10.27.130:43285): Couldn't send request to peer b85d150f168f406bb31ff44150b2b1a1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 218dfac06cf841c6aced6781154f283a. This is attempt 301: this message will repeat every 5th retry.
I20260502 20:06:15.295567 13211 master_runner.cc:186] Error getting master registration for 127.10.27.190:46101: Network error: Client connection negotiation failed: client connection to 127.10.27.190:46101: connect: Connection refused (error 111),
I20260502 20:06:15.295722 13211 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 20:06:15.337918 13231 maintenance_manager.cc:419] P b470a66ad54f46b1b44a80dd1edf214e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 5294 bytes on disk
I20260502 20:06:15.341333 13230 maintenance_manager.cc:643] P b470a66ad54f46b1b44a80dd1edf214e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.003s user 0.003s sys 0.000s Metrics: {"dirs.queue_time_us":181,"thread_start_us":172,"threads_started":2,"wal-append.queue_time_us":230}
W20260502 20:06:15.510834 11328 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:06:15.511062 11328 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:06:15.511160 11328 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
W20260502 20:06:15.511211 11328 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
F20260502 20:06:15.521711 11359 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Aborted at 1777752375 (unix time) try "date -d @1777752375" if you are using GNU date ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525671 11345 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b19cf190454d42ff99d3fcab96f783b1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525731 11356 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525671 11345 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b19cf190454d42ff99d3fcab96f783b1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525731 11356 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.526998 11352 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e80000286e) received by PID 10350 (TID 0x7fec0d821700) from PID 10350; stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525671 11345 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b19cf190454d42ff99d3fcab96f783b1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525731 11356 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.526998 11352 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.529141 11353 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7fec23e98980 (unknown) at ??:0
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525671 11345 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b19cf190454d42ff99d3fcab96f783b1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525731 11356 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.526998 11352 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.529141 11353 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530361 11342 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b8d71e2af3a4d8ca933ba45c43b464e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525671 11345 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b19cf190454d42ff99d3fcab96f783b1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525731 11356 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.526998 11352 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.529141 11353 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530361 11342 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b8d71e2af3a4d8ca933ba45c43b464e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530431 11360 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525671 11345 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b19cf190454d42ff99d3fcab96f783b1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525731 11356 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.526998 11352 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.529141 11353 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530361 11342 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b8d71e2af3a4d8ca933ba45c43b464e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530431 11360 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530412 11357 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525671 11345 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b19cf190454d42ff99d3fcab96f783b1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525731 11356 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.526998 11352 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.529141 11353 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530361 11342 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b8d71e2af3a4d8ca933ba45c43b464e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530431 11360 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530412 11357 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530537 11358 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525671 11345 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b19cf190454d42ff99d3fcab96f783b1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525731 11356 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.526998 11352 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.529141 11353 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530361 11342 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b8d71e2af3a4d8ca933ba45c43b464e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530431 11360 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530412 11357 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530537 11358 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530637 11338 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89091fe7dff644288a504e28216d5d69 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525671 11345 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b19cf190454d42ff99d3fcab96f783b1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525731 11356 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.526998 11352 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.529141 11353 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530361 11342 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b8d71e2af3a4d8ca933ba45c43b464e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530431 11360 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530412 11357 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530537 11358 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530637 11338 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89091fe7dff644288a504e28216d5d69 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530651 11337 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2eef3c375d5248539d96b67ea8bbc2be on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: Dele @ 0x7fec21a16e87 gsignal
teTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525671 11345 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b19cf190454d42ff99d3fcab96f783b1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525731 11356 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.526998 11352 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.529141 11353 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530361 11342 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b8d71e2af3a4d8ca933ba45c43b464e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530431 11360 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530412 11357 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530537 11358 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530637 11338 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89091fe7dff644288a504e28216d5d69 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530651 11337 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2eef3c375d5248539d96b67ea8bbc2be on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530719 11335 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bcbf40331f9a4354927f24a56b69f1f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525671 11345 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b19cf190454d42ff99d3fcab96f783b1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525731 11356 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.526998 11352 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.529141 11353 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530361 11342 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b8d71e2af3a4d8ca933ba45c43b464e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530431 11360 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530412 11357 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530537 11358 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530637 11338 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89091fe7dff644288a504e28216d5d69 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530651 11337 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2eef3c375d5248539d96b67ea8bbc2be on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530719 11335 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bcbf40331f9a4354927f24a56b69f1f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530740 11348 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530359 11349 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530664 11354 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525671 11345 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b19cf190454d42ff99d3fcab96f783b1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525731 11356 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.526998 11352 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.529141 11353 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530361 11342 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b8d71e2af3a4d8ca933ba45c43b464e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530431 11360 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530412 11357 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530537 11358 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530637 11338 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89091fe7dff644288a504e28216d5d69 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530651 11337 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2eef3c375d5248539d96b67ea8bbc2be on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530719 11335 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bcbf40331f9a4354927f24a56b69f1f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530740 11348 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530359 11349 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530664 11354 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 20:06:15.521788 11340 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8ad450efb0df42d2bb35c3f8d3e0b78e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521732 11343 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8fe0445705b144e5adbda1bd0c71ba52 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.521849 11347 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523032 11339 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89adbf9d323b449db6deb0fa830829bd on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11351 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.523100 11346 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524330 11344 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e36b131ff7344eba80b753a6b7ff4c11 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.524340 11355 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525563 11336 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c1f90f27e25c436bb0c43af980cece1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525641 11350 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525671 11345 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b19cf190454d42ff99d3fcab96f783b1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.525731 11356 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.526998 11352 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.529141 11353 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530361 11342 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b8d71e2af3a4d8ca933ba45c43b464e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530431 11360 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530412 11357 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530537 11358 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530637 11338 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_89091fe7dff644288a504e28216d5d69 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530651 11337 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2eef3c375d5248539d96b67ea8bbc2be on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530719 11335 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_bcbf40331f9a4354927f24a56b69f1f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530740 11348 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530359 11349 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)F20260502 20:06:15.530664 11354 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.10.27.190:46101,127.10.27.189:46281,127.10.27.188:33369, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.10.27.189:46281: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7fec21a187f1 abort at ??:0
@ 0x7fec2287fdcd google::LogMessage::Fail() at ??:0
@ 0x7fec22883b93 google::LogMessage::SendToLog() at ??:0
@ 0x7fec2287f7cc google::LogMessage::Flush() at ??:0
@ 0x7fec22880f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x561213b0a9bd kudu::MasterStressTest::CreateTableThread() at ??:0
@ 0x561213b1d6fc std::__invoke_impl<>() at ??:0
@ 0x561213b1b438 std::__invoke<>() at ??:0
@ 0x561213b22a89 _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTcl8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at ??:0
@ 0x561213b21a8d std::thread::_Invoker<>::operator()() at ??:0
@ 0x561213b2080a std::thread::_State_impl<>::_M_run() at ??:0
@ 0x7fec2209e6df (unknown) at ??:0
@ 0x7fec23e8d6db start_thread at ??:0
@ 0x7fec21af961f clone at ??:0