Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
2026-05-02T14:00:31Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-05-02T14:00:31Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskjX7ZjU/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskjX7ZjU/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/security.properties
2026-05-02 14:00:40: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskjX7ZjU/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskjX7ZjU/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260502 14:00:49.964699 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--webserver_interface=127.6.125.126
--webserver_port=0
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 14:00:50.127820 6933 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:00:50.128314 6933 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:00:50.128417 6933 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:00:50.133360 6933 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 14:00:50.133467 6933 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:00:50.133500 6933 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 14:00:50.133523 6933 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 14:00:50.139070 6933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.125.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.6933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:00:50.140292 6933 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:00:50.141563 6933 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:00:50.150835 6939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:50.150902 6938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:50.150823 6941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:00:50.151120 6933 server_base.cc:1061] running on GCE node
I20260502 14:00:50.151741 6933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:00:50.153059 6933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:00:50.154309 6933 hybrid_clock.cc:648] HybridClock initialized: now 1777730450154267 us; error 63 us; skew 500 ppm
I20260502 14:00:50.158193 6933 webserver.cc:492] Webserver started at http://127.6.125.126:39397/ using document root <none> and password file <none>
I20260502 14:00:50.159026 6933 fs_manager.cc:362] Metadata directory not provided
I20260502 14:00:50.159104 6933 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:00:50.159327 6933 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260502 14:00:50.161229 6933 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/instance:
uuid: "9d590d630acd4892b59504b1c66c4f2d"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:00:50.161767 6933 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal/instance:
uuid: "9d590d630acd4892b59504b1c66c4f2d"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:00:50.166952 6933 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260502 14:00:50.169787 6947 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:00:50.171118 6933 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260502 14:00:50.171300 6933 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
uuid: "9d590d630acd4892b59504b1c66c4f2d"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:00:50.171417 6933 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:00:50.183663 6933 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:00:50.184572 6933 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:00:50.184828 6933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:00:50.196863 6933 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.126:45121
I20260502 14:00:50.196908 6999 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.126:45121 every 8 connection(s)
I20260502 14:00:50.198894 6933 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
I20260502 14:00:50.203105 7000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:50.203881 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 6933
I20260502 14:00:50.204075 6645 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal/instance
I20260502 14:00:50.206153 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.125:46147
--webserver_interface=127.6.125.125
--webserver_port=0
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260502 14:00:50.207620 7000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } has no permanent_uuid. Determining permanent_uuid...
I20260502 14:00:50.220203 7000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } has no permanent_uuid. Determining permanent_uuid...
W20260502 14:00:50.221374 6951 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:00:50.222484 7000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:00:50.271739 7000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } attempt: 1
W20260502 14:00:50.273417 7000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:00:50.316121 7001 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:00:50.316377 7001 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:00:50.316419 7001 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:00:50.320061 7001 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 14:00:50.320142 7001 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:00:50.320168 7001 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 14:00:50.320185 7001 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 14:00:50.324580 7001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.125:46147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.6.125.125
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.7001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:00:50.326146 7001 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:00:50.327610 7001 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:00:50.333662 7009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:50.333730 7012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:50.333860 7010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:00:50.334028 7001 server_base.cc:1061] running on GCE node
I20260502 14:00:50.334527 7001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:00:50.335454 7001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:00:50.336637 7001 hybrid_clock.cc:648] HybridClock initialized: now 1777730450336611 us; error 39 us; skew 500 ppm
I20260502 14:00:50.338646 7001 webserver.cc:492] Webserver started at http://127.6.125.125:34081/ using document root <none> and password file <none>
I20260502 14:00:50.339277 7001 fs_manager.cc:362] Metadata directory not provided
I20260502 14:00:50.339339 7001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:00:50.339529 7001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260502 14:00:50.341209 7001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/instance:
uuid: "78b194cad3b9424395e9a403da13ba80"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:00:50.341684 7001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal/instance:
uuid: "78b194cad3b9424395e9a403da13ba80"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:00:50.341671 7000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } attempt: 2
W20260502 14:00:50.343204 7000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:00:50.345618 7001 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260502 14:00:50.348155 7018 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:00:50.349373 7001 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260502 14:00:50.349498 7001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
uuid: "78b194cad3b9424395e9a403da13ba80"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:00:50.349660 7001 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:00:50.366925 7001 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:00:50.367630 7001 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:00:50.367798 7001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:00:50.375370 7001 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.125:46147
I20260502 14:00:50.375370 7070 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.125:46147 every 8 connection(s)
I20260502 14:00:50.376539 7001 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/info.pb
I20260502 14:00:50.379724 7071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:50.383620 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 7001
I20260502 14:00:50.383384 7071 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } has no permanent_uuid. Determining permanent_uuid...
I20260502 14:00:50.383733 6645 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal/instance
I20260502 14:00:50.384522 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.124:43159
--webserver_interface=127.6.125.124
--webserver_port=0
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260502 14:00:50.394899 7071 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } has no permanent_uuid. Determining permanent_uuid...
I20260502 14:00:50.403196 7071 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } has no permanent_uuid. Determining permanent_uuid...
W20260502 14:00:50.405170 7021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:00:50.406438 7071 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.125.124:43159: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:00:50.434448 7000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } attempt: 3
I20260502 14:00:50.440855 7000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } has no permanent_uuid. Determining permanent_uuid...
W20260502 14:00:50.442505 7000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.125.124:43159: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:00:50.455744 7071 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } attempt: 1
W20260502 14:00:50.457438 7071 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.125.124:43159: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:00:50.473734 7000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } attempt: 1
W20260502 14:00:50.475404 7000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.125.124:43159: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:00:50.511942 7072 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:00:50.512212 7072 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:00:50.512270 7072 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:00:50.515993 7072 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 14:00:50.516188 7072 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:00:50.516232 7072 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 14:00:50.516268 7072 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 14:00:50.520726 7072 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.124:43159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.6.125.124
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.7072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:00:50.522025 7072 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:00:50.523228 7072 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260502 14:00:50.525671 7071 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } attempt: 2
W20260502 14:00:50.527273 7071 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.125.124:43159: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:00:50.530301 7072 server_base.cc:1061] running on GCE node
W20260502 14:00:50.530226 7081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:50.530225 7083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:50.530225 7080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:00:50.531113 7072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:00:50.532336 7072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:00:50.533526 7072 hybrid_clock.cc:648] HybridClock initialized: now 1777730450533486 us; error 49 us; skew 500 ppm
I20260502 14:00:50.536173 7072 webserver.cc:492] Webserver started at http://127.6.125.124:45523/ using document root <none> and password file <none>
I20260502 14:00:50.537010 7072 fs_manager.cc:362] Metadata directory not provided
I20260502 14:00:50.537099 7072 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:00:50.537317 7072 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260502 14:00:50.538995 7072 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data/instance:
uuid: "a5d257c30a994bfdb03242b10606426f"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:00:50.539481 7072 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/wal/instance:
uuid: "a5d257c30a994bfdb03242b10606426f"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:00:50.543157 7072 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260502 14:00:50.545924 7089 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:00:50.547353 7072 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260502 14:00:50.547493 7072 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/wal
uuid: "a5d257c30a994bfdb03242b10606426f"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:00:50.547602 7072 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:00:50.550611 7000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } attempt: 2
W20260502 14:00:50.552286 7000 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.6.125.124:43159: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:00:50.567221 7072 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:00:50.568230 7072 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:00:50.568425 7072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:00:50.575476 7141 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.124:43159 every 8 connection(s)
I20260502 14:00:50.575479 7072 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.124:43159
I20260502 14:00:50.576720 7072 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data/info.pb
I20260502 14:00:50.579674 7142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:50.582772 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 7072
I20260502 14:00:50.582870 6645 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/wal/instance
I20260502 14:00:50.582764 7142 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } has no permanent_uuid. Determining permanent_uuid...
I20260502 14:00:50.593116 7142 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } has no permanent_uuid. Determining permanent_uuid...
I20260502 14:00:50.598491 7142 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } has no permanent_uuid. Determining permanent_uuid...
I20260502 14:00:50.607597 7142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Bootstrap starting.
I20260502 14:00:50.610154 7142 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:50.611104 7142 log.cc:826] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Log is configured to *not* fsync() on all Append() calls
I20260502 14:00:50.613174 7142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: No bootstrap required, opened a new log
I20260502 14:00:50.616384 7142 raft_consensus.cc:359] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:50.616608 7142 raft_consensus.cc:385] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:50.616658 7142 raft_consensus.cc:740] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5d257c30a994bfdb03242b10606426f, State: Initialized, Role: FOLLOWER
I20260502 14:00:50.617120 7142 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:50.617652 7150 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:50.617774 7150 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:50.618489 7071 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } attempt: 3
I20260502 14:00:50.618724 7142 sys_catalog.cc:565] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: configured and running, proceeding with master startup.
I20260502 14:00:50.626212 7071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Bootstrap starting.
I20260502 14:00:50.624511 7072 master_runner.cc:186] Error getting master registration for 127.6.125.126:45121: OK, instance_id { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" instance_seqno: 1777730450192944 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260502 14:00:50.626879 7072 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:00:50.629472 7164 catalog_manager.cc:1568] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260502 14:00:50.629730 7164 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260502 14:00:50.629493 7071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:50.631320 7071 log.cc:826] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Log is configured to *not* fsync() on all Append() calls
I20260502 14:00:50.633723 7071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: No bootstrap required, opened a new log
I20260502 14:00:50.637719 7071 raft_consensus.cc:359] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:50.640607 7071 raft_consensus.cc:385] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:50.640795 7071 raft_consensus.cc:740] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b194cad3b9424395e9a403da13ba80, State: Initialized, Role: FOLLOWER
I20260502 14:00:50.641572 7071 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:50.643159 7150 raft_consensus.cc:493] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:50.643736 7071 sys_catalog.cc:565] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: configured and running, proceeding with master startup.
I20260502 14:00:50.643805 7168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:50.643729 7150 raft_consensus.cc:515] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:50.643949 7168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:50.645746 7150 leader_election.cc:290] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147)
I20260502 14:00:50.647374 7044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80" is_pre_election: true
I20260502 14:00:50.647743 7044 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5d257c30a994bfdb03242b10606426f in term 0.
I20260502 14:00:50.648320 7093 leader_election.cc:304] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f; no voters:
I20260502 14:00:50.648653 7150 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:50.648736 7150 raft_consensus.cc:493] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:50.648777 7150 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:50.651731 7000 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } attempt: 3
I20260502 14:00:50.656683 7001 master_runner.cc:186] Error getting master registration for 127.6.125.126:45121: OK, instance_id { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" instance_seqno: 1777730450192944 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260502 14:00:50.659675 7001 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:00:50.662571 7182 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260502 14:00:50.662765 7182 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260502 14:00:50.676537 7000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap starting.
I20260502 14:00:50.679529 7000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:50.680884 7000 log.cc:826] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Log is configured to *not* fsync() on all Append() calls
I20260502 14:00:50.684063 7000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: No bootstrap required, opened a new log
I20260502 14:00:50.695240 7000 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:50.695652 7000 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:50.695739 7000 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d590d630acd4892b59504b1c66c4f2d, State: Initialized, Role: FOLLOWER
I20260502 14:00:50.696584 7000 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:50.699519 6974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d" is_pre_election: true
I20260502 14:00:50.699877 6974 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5d257c30a994bfdb03242b10606426f in term 0.
I20260502 14:00:50.700806 7000 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: configured and running, proceeding with master startup.
I20260502 14:00:50.705612 7186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:50.708052 7186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
W20260502 14:00:50.722759 7200 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260502 14:00:50.722870 7200 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260502 14:00:50.734272 7150 raft_consensus.cc:515] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:50.734843 7150 leader_election.cc:290] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 1 election: Requested vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147)
I20260502 14:00:50.738423 6933 master_runner.cc:232] Existing masters have differing terms: 0 vs 1
I20260502 14:00:50.738586 6933 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:00:50.738694 6974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d"
I20260502 14:00:50.738823 6974 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:50.740077 7044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80"
I20260502 14:00:50.740252 7044 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 0 FOLLOWER]: Advancing to term 1
W20260502 14:00:50.819762 7095 tablet.cc:2404] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260502 14:00:50.834126 7044 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5d257c30a994bfdb03242b10606426f in term 1.
I20260502 14:00:50.835641 7093 leader_election.cc:304] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f; no voters:
I20260502 14:00:50.835932 7150 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:50.836155 7150 raft_consensus.cc:697] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 1 LEADER]: Becoming Leader. State: Replica: a5d257c30a994bfdb03242b10606426f, State: Running, Role: LEADER
I20260502 14:00:50.836517 7150 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:50.837903 6974 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5d257c30a994bfdb03242b10606426f in term 1.
I20260502 14:00:50.838510 7150 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5d257c30a994bfdb03242b10606426f. Latest consensus state: current_term: 1 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:50.838692 7150 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: LEADER
I20260502 14:00:50.844990 7205 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 14:00:50.846372 7205 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 14:00:50.865031 7044 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 1 FOLLOWER]: Refusing update from remote peer a5d257c30a994bfdb03242b10606426f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 14:00:50.865971 6974 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 1 FOLLOWER]: Refusing update from remote peer a5d257c30a994bfdb03242b10606426f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 14:00:50.866780 7150 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 14:00:50.869374 7024 tablet.cc:2404] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260502 14:00:50.875382 7186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5d257c30a994bfdb03242b10606426f. Latest consensus state: current_term: 1 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:50.875577 7186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:50.875756 7150 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:50.882270 7168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5d257c30a994bfdb03242b10606426f. Latest consensus state: current_term: 1 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:50.882696 7168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:50.898113 7203 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:50.898290 7203 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: LEADER
I20260502 14:00:50.902880 7168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:50.903044 7168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:50.904634 7150 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:50.904784 7150 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: LEADER
I20260502 14:00:50.906209 7186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:50.906374 7186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:50.907069 7207 mvcc.cc:204] Tried to move back new op lower bound from 7281583926730481664 to 7281583926629650432. Current Snapshot: MvccSnapshot[applied={T|T < 7281583926730481664}]
I20260502 14:00:50.911441 7209 mvcc.cc:204] Tried to move back new op lower bound from 7281583926730481664 to 7281583926629650432. Current Snapshot: MvccSnapshot[applied={T|T < 7281583926730481664}]
I20260502 14:00:50.912093 7205 catalog_manager.cc:1357] Generated new cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:00:50.912166 7205 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 14:00:50.928925 7205 catalog_manager.cc:1380] Generated new certificate authority record
I20260502 14:00:50.934299 7205 catalog_manager.cc:1514] Loading token signing keys...
I20260502 14:00:50.951743 7205 catalog_manager.cc:6044] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Generated new TSK 0
I20260502 14:00:50.952620 7205 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 14:00:50.953200 7205 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 14:00:50.953613 7205 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: -1
I20260502 14:00:50.967181 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.125.65:0
--local_ip_for_outbound_sockets=127.6.125.65
--webserver_interface=127.6.125.65
--webserver_port=0
--tserver_master_addrs=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260502 14:00:51.088132 7215 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:00:51.088403 7215 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:00:51.088480 7215 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:00:51.092399 7215 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:00:51.092578 7215 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.125.65
I20260502 14:00:51.097456 7215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.125.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.125.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--never_fsync=true
--heap_profile_path=/tmp/kudu.7215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.125.65
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:00:51.098783 7215 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:00:51.100091 7215 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:00:51.108146 7223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:51.108238 7220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:51.108178 7221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:00:51.108498 7215 server_base.cc:1061] running on GCE node
I20260502 14:00:51.108991 7215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:00:51.109613 7215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:00:51.112965 7215 hybrid_clock.cc:648] HybridClock initialized: now 1777730451112657 us; error 316 us; skew 500 ppm
I20260502 14:00:51.115330 7215 webserver.cc:492] Webserver started at http://127.6.125.65:42881/ using document root <none> and password file <none>
I20260502 14:00:51.116001 7215 fs_manager.cc:362] Metadata directory not provided
I20260502 14:00:51.116071 7215 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:00:51.116276 7215 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260502 14:00:51.117944 7215 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/data/instance:
uuid: "4dacd17b49934d2c99a91c60aa672f02"
format_stamp: "Formatted at 2026-05-02 14:00:51 on dist-test-slave-6vpk"
I20260502 14:00:51.118444 7215 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/instance:
uuid: "4dacd17b49934d2c99a91c60aa672f02"
format_stamp: "Formatted at 2026-05-02 14:00:51 on dist-test-slave-6vpk"
I20260502 14:00:51.122359 7215 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260502 14:00:51.125020 7229 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:00:51.126297 7215 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260502 14:00:51.126439 7215 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal
uuid: "4dacd17b49934d2c99a91c60aa672f02"
format_stamp: "Formatted at 2026-05-02 14:00:51 on dist-test-slave-6vpk"
I20260502 14:00:51.126549 7215 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:00:51.158257 7215 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:00:51.159139 7215 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:00:51.159380 7215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:00:51.160104 7215 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260502 14:00:51.161382 7215 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260502 14:00:51.161439 7215 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260502 14:00:51.161489 7215 ts_tablet_manager.cc:616] Registered 0 tablets
I20260502 14:00:51.161549 7215 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260502 14:00:51.171607 7215 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.65:37597
I20260502 14:00:51.171624 7342 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.65:37597 every 8 connection(s)
I20260502 14:00:51.172711 7215 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/data/info.pb
I20260502 14:00:51.180505 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 7215
I20260502 14:00:51.180632 6645 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/instance
I20260502 14:00:51.184955 7343 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:00:51.185042 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.125.66:0
--local_ip_for_outbound_sockets=127.6.125.66
--webserver_interface=127.6.125.66
--webserver_port=0
--tserver_master_addrs=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260502 14:00:51.185240 7343 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:51.186673 7343 heartbeater.cc:507] Master 127.6.125.126:45121 requested a full tablet report, sending...
I20260502 14:00:51.188133 7345 heartbeater.cc:344] Connected to a master server at 127.6.125.125:46147
I20260502 14:00:51.188230 7345 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:51.188436 7345 heartbeater.cc:507] Master 127.6.125.125:46147 requested a full tablet report, sending...
I20260502 14:00:51.189323 6963 ts_manager.cc:194] Registered new tserver with Master: 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:51.190320 7344 heartbeater.cc:344] Connected to a master server at 127.6.125.124:43159
I20260502 14:00:51.190407 7344 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:51.190641 7344 heartbeater.cc:507] Master 127.6.125.124:43159 requested a full tablet report, sending...
I20260502 14:00:51.191010 7035 ts_manager.cc:194] Registered new tserver with Master: 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:51.192896 7102 ts_manager.cc:194] Registered new tserver with Master: 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:51.194499 7102 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.125.65:50393
W20260502 14:00:51.306106 7353 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:00:51.306392 7353 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:00:51.306465 7353 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:00:51.310041 7353 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:00:51.310201 7353 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.125.66
I20260502 14:00:51.314374 7353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.125.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.125.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--never_fsync=true
--heap_profile_path=/tmp/kudu.7353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.125.66
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:00:51.315500 7353 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:00:51.316696 7353 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:00:51.323827 7358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:51.323865 7359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:51.323938 7361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:00:51.324254 7353 server_base.cc:1061] running on GCE node
I20260502 14:00:51.324683 7353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:00:51.325305 7353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:00:51.326490 7353 hybrid_clock.cc:648] HybridClock initialized: now 1777730451326476 us; error 34 us; skew 500 ppm
I20260502 14:00:51.328550 7353 webserver.cc:492] Webserver started at http://127.6.125.66:39223/ using document root <none> and password file <none>
I20260502 14:00:51.329167 7353 fs_manager.cc:362] Metadata directory not provided
I20260502 14:00:51.329231 7353 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:00:51.329450 7353 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260502 14:00:51.331125 7353 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/data/instance:
uuid: "1be1472a04ae46e48d852d66903d9c84"
format_stamp: "Formatted at 2026-05-02 14:00:51 on dist-test-slave-6vpk"
I20260502 14:00:51.331586 7353 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/instance:
uuid: "1be1472a04ae46e48d852d66903d9c84"
format_stamp: "Formatted at 2026-05-02 14:00:51 on dist-test-slave-6vpk"
I20260502 14:00:51.335340 7353 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260502 14:00:51.339712 7367 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:00:51.342420 7353 fs_manager.cc:730] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260502 14:00:51.342774 7353 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal
uuid: "1be1472a04ae46e48d852d66903d9c84"
format_stamp: "Formatted at 2026-05-02 14:00:51 on dist-test-slave-6vpk"
I20260502 14:00:51.342923 7353 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:00:51.372695 7353 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:00:51.373646 7353 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:00:51.373837 7353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:00:51.374423 7353 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260502 14:00:51.375758 7353 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260502 14:00:51.375828 7353 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260502 14:00:51.375880 7353 ts_tablet_manager.cc:616] Registered 0 tablets
I20260502 14:00:51.375945 7353 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260502 14:00:51.389020 7353 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.66:41873
I20260502 14:00:51.389261 7480 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.66:41873 every 8 connection(s)
I20260502 14:00:51.391031 7353 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/data/info.pb
I20260502 14:00:51.395121 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 7353
I20260502 14:00:51.395268 6645 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/instance
I20260502 14:00:51.398291 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.125.67:0
--local_ip_for_outbound_sockets=127.6.125.67
--webserver_interface=127.6.125.67
--webserver_port=0
--tserver_master_addrs=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260502 14:00:51.405851 7483 heartbeater.cc:344] Connected to a master server at 127.6.125.125:46147
I20260502 14:00:51.406157 7483 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:51.406893 7483 heartbeater.cc:507] Master 127.6.125.125:46147 requested a full tablet report, sending...
I20260502 14:00:51.408638 7035 ts_manager.cc:194] Registered new tserver with Master: 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:51.408872 7481 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:00:51.408941 7482 heartbeater.cc:344] Connected to a master server at 127.6.125.124:43159
I20260502 14:00:51.408975 7481 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:51.409004 7482 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:51.409221 7482 heartbeater.cc:507] Master 127.6.125.124:43159 requested a full tablet report, sending...
I20260502 14:00:51.409219 7481 heartbeater.cc:507] Master 127.6.125.126:45121 requested a full tablet report, sending...
I20260502 14:00:51.410351 7102 ts_manager.cc:194] Registered new tserver with Master: 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:51.410434 6963 ts_manager.cc:194] Registered new tserver with Master: 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:51.411162 7102 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.125.66:51507
I20260502 14:00:51.451956 7489 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:00:51.452116 7490 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:00:51.452134 7489 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:51.452243 7490 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:51.453397 7490 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:00:51.453975 6974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d" is_pre_election: true
I20260502 14:00:51.454149 6974 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78b194cad3b9424395e9a403da13ba80 in term 1.
I20260502 14:00:51.454358 7116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a5d257c30a994bfdb03242b10606426f" is_pre_election: true
I20260502 14:00:51.454604 7044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d590d630acd4892b59504b1c66c4f2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80" is_pre_election: true
I20260502 14:00:51.454726 7044 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d590d630acd4892b59504b1c66c4f2d in term 1.
I20260502 14:00:51.455067 7116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d590d630acd4892b59504b1c66c4f2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a5d257c30a994bfdb03242b10606426f" is_pre_election: true
I20260502 14:00:51.455175 7020 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters: a5d257c30a994bfdb03242b10606426f
I20260502 14:00:51.455235 6951 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters:
I20260502 14:00:51.455515 7490 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260502 14:00:51.455593 7490 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:00:51.455650 7489 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:00:51.455693 7490 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 1 FOLLOWER]: Advancing to term 2
I20260502 14:00:51.456060 7489 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260502 14:00:51.456149 7489 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:00:51.456202 7489 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 1 FOLLOWER]: Advancing to term 2
I20260502 14:00:51.535739 7490 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:51.535717 7489 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:51.536294 7489 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 2 election: Requested vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:00:51.536303 7490 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 2 election: Requested vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:00:51.536931 7116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d590d630acd4892b59504b1c66c4f2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a5d257c30a994bfdb03242b10606426f"
I20260502 14:00:51.536968 6974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d"
I20260502 14:00:51.537146 6974 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 78b194cad3b9424395e9a403da13ba80 in current term 2: Already voted for candidate 9d590d630acd4892b59504b1c66c4f2d in this term.
W20260502 14:00:51.537048 7488 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:00:51.537335 7488 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:00:51.537415 7488 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260502 14:00:51.537839 7044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d590d630acd4892b59504b1c66c4f2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80"
I20260502 14:00:51.537858 7116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a5d257c30a994bfdb03242b10606426f"
I20260502 14:00:51.538009 7044 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d590d630acd4892b59504b1c66c4f2d in current term 2: Already voted for candidate 78b194cad3b9424395e9a403da13ba80 in this term.
I20260502 14:00:51.538333 6951 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:00:51.538374 7021 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80; no voters: 9d590d630acd4892b59504b1c66c4f2d, a5d257c30a994bfdb03242b10606426f
I20260502 14:00:51.538636 7489 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260502 14:00:51.538690 7490 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260502 14:00:51.541635 7488 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:00:51.541790 7488 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.125.67
I20260502 14:00:51.544543 7044 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 2 FOLLOWER]: Rejecting Update request from peer a5d257c30a994bfdb03242b10606426f for earlier term 1. Current term is 2. Ops: []
I20260502 14:00:51.545094 7495 consensus_queue.cc:1059] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260502 14:00:51.545429 7495 raft_consensus.cc:3055] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 1 LEADER]: Stepping down as leader of term 1
I20260502 14:00:51.545493 7495 raft_consensus.cc:740] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5d257c30a994bfdb03242b10606426f, State: Running, Role: LEADER
I20260502 14:00:51.545693 7495 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:51.546010 7495 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 1 FOLLOWER]: Advancing to term 2
I20260502 14:00:51.546386 7488 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.125.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.125.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--never_fsync=true
--heap_profile_path=/tmp/kudu.7488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.125.67
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:00:51.547485 7488 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:00:51.548703 7488 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:00:51.557886 7499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:51.557816 7501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:51.557832 7498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:00:51.558447 7488 server_base.cc:1061] running on GCE node
I20260502 14:00:51.558976 7488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:00:51.559585 7488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:00:51.560781 7488 hybrid_clock.cc:648] HybridClock initialized: now 1777730451560749 us; error 50 us; skew 500 ppm
I20260502 14:00:51.563097 7488 webserver.cc:492] Webserver started at http://127.6.125.67:35397/ using document root <none> and password file <none>
I20260502 14:00:51.563720 7488 fs_manager.cc:362] Metadata directory not provided
I20260502 14:00:51.563788 7488 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:00:51.564038 7488 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260502 14:00:51.565805 7488 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/data/instance:
uuid: "c2964848cb1648a4bc2c1d671cc54f62"
format_stamp: "Formatted at 2026-05-02 14:00:51 on dist-test-slave-6vpk"
I20260502 14:00:51.566318 7488 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/instance:
uuid: "c2964848cb1648a4bc2c1d671cc54f62"
format_stamp: "Formatted at 2026-05-02 14:00:51 on dist-test-slave-6vpk"
I20260502 14:00:51.572074 7488 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260502 14:00:51.575697 7507 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:00:51.577392 7488 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260502 14:00:51.577543 7488 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal
uuid: "c2964848cb1648a4bc2c1d671cc54f62"
format_stamp: "Formatted at 2026-05-02 14:00:51 on dist-test-slave-6vpk"
I20260502 14:00:51.577657 7488 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:00:51.618705 7488 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:00:51.619458 7488 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:00:51.619660 7488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:00:51.620450 7488 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260502 14:00:51.621589 7488 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260502 14:00:51.621656 7488 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260502 14:00:51.621712 7488 ts_tablet_manager.cc:616] Registered 0 tablets
I20260502 14:00:51.621737 7488 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260502 14:00:51.633584 7488 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.67:34739
I20260502 14:00:51.633669 7620 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.67:34739 every 8 connection(s)
I20260502 14:00:51.634806 7488 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/data/info.pb
I20260502 14:00:51.637423 7164 catalog_manager.cc:1612] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 14:00:51.643841 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 7488
I20260502 14:00:51.643996 6645 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/instance
I20260502 14:00:51.646057 7621 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:00:51.646893 7621 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:51.647387 7622 heartbeater.cc:344] Connected to a master server at 127.6.125.124:43159
I20260502 14:00:51.647495 7622 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:51.647607 7621 heartbeater.cc:507] Master 127.6.125.126:45121 requested a full tablet report, sending...
I20260502 14:00:51.647622 7623 heartbeater.cc:344] Connected to a master server at 127.6.125.125:46147
I20260502 14:00:51.647722 7622 heartbeater.cc:507] Master 127.6.125.124:43159 requested a full tablet report, sending...
I20260502 14:00:51.647739 7623 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:51.648169 7623 heartbeater.cc:507] Master 127.6.125.125:46147 requested a full tablet report, sending...
I20260502 14:00:51.648917 7102 ts_manager.cc:194] Registered new tserver with Master: c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:51.648954 6963 ts_manager.cc:194] Registered new tserver with Master: c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:51.649047 7033 ts_manager.cc:194] Registered new tserver with Master: c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:51.653268 6645 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20260502 14:00:51.664170 7182 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:00:51.664250 7182 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: loading cluster ID for follower catalog manager: success
I20260502 14:00:51.665968 7182 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: acquiring CA information for follower catalog manager: success
I20260502 14:00:51.667234 7182 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 14:00:51.697028 7344 heartbeater.cc:499] Master 127.6.125.124:43159 was elected leader, sending a full tablet report...
I20260502 14:00:51.724217 7200 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:00:51.724308 7200 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: loading cluster ID for follower catalog manager: success
I20260502 14:00:51.726114 7200 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: acquiring CA information for follower catalog manager: success
I20260502 14:00:51.727272 7200 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 14:00:51.913095 7482 heartbeater.cc:499] Master 127.6.125.124:43159 was elected leader, sending a full tablet report...
I20260502 14:00:52.014844 7495 raft_consensus.cc:493] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:52.015009 7495 raft_consensus.cc:515] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:52.015457 7495 leader_election.cc:290] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147)
I20260502 14:00:52.015954 7044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80" is_pre_election: true
I20260502 14:00:52.015926 6974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d" is_pre_election: true
I20260502 14:00:52.016109 6974 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5d257c30a994bfdb03242b10606426f in term 2.
I20260502 14:00:52.016109 7044 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5d257c30a994bfdb03242b10606426f in term 2.
I20260502 14:00:52.016505 7091 leader_election.cc:304] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d, a5d257c30a994bfdb03242b10606426f; no voters:
I20260502 14:00:52.016737 7495 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260502 14:00:52.016786 7495 raft_consensus.cc:493] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:52.016815 7495 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 2 FOLLOWER]: Advancing to term 3
I20260502 14:00:52.035419 7495 raft_consensus.cc:515] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:52.036065 7495 leader_election.cc:290] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 3 election: Requested vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147)
I20260502 14:00:52.036549 7044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80"
I20260502 14:00:52.036540 6974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d"
I20260502 14:00:52.036682 7044 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 2 FOLLOWER]: Advancing to term 3
I20260502 14:00:52.036685 6974 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 2 FOLLOWER]: Advancing to term 3
I20260502 14:00:52.037578 6974 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5d257c30a994bfdb03242b10606426f in term 3.
I20260502 14:00:52.037658 7044 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5d257c30a994bfdb03242b10606426f in term 3.
I20260502 14:00:52.037915 7091 leader_election.cc:304] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d, a5d257c30a994bfdb03242b10606426f; no voters:
I20260502 14:00:52.038092 7495 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 3 FOLLOWER]: Leader election won for term 3
I20260502 14:00:52.038185 7495 raft_consensus.cc:697] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 3 LEADER]: Becoming Leader. State: Replica: a5d257c30a994bfdb03242b10606426f, State: Running, Role: LEADER
I20260502 14:00:52.038324 7495 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:52.039028 7496 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5d257c30a994bfdb03242b10606426f. Latest consensus state: current_term: 3 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:52.039139 7496 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: LEADER
I20260502 14:00:52.039383 7636 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 14:00:52.040243 7636 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 14:00:52.040688 7636 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:00:52.040736 7636 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 14:00:52.041393 7636 catalog_manager.cc:1514] Loading token signing keys...
I20260502 14:00:52.041885 7636 catalog_manager.cc:6055] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Loaded TSK: 0
I20260502 14:00:52.042312 7636 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 14:00:52.042681 7636 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 14:00:52.043005 7636 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: -1
I20260502 14:00:52.072547 6645 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu with pid 6933
I20260502 14:00:52.072731 7103 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_6c9325cba2ed431fa72add0d6f4fb869"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:52.073084 7104 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_2866c4520a3d40c4b3c6ca93424e5a0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:52.073262 7100 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_a373f862bd114b1090e1aeba01375597"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:52.072624 7102 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_e209f5be8519489e973e7a888ad911ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:52.073501 7105 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_5e304d38082c4c6baeee1789cc1d2de2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:52.073737 7106 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_2f350d07bc2340ceaf7259efed2efac2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:52.074349 7098 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_d303c0450b934f2bb0f8ab01b92f2e67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:52.074548 7101 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_22762929a67d4e56be830cb18eaa2af8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:52.074376 7097 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_79e5262b7980424fbe659116c4785e9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:52.074620 7099 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_0912854d0fb44cf69bf731fbb257be24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260502 14:00:52.115620 7103 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6c9325cba2ed431fa72add0d6f4fb869 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 14:00:52.115800 7106 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2f350d07bc2340ceaf7259efed2efac2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 14:00:52.116048 7102 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e209f5be8519489e973e7a888ad911ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 14:00:52.116344 7105 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5e304d38082c4c6baeee1789cc1d2de2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 14:00:52.117743 7100 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a373f862bd114b1090e1aeba01375597 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 14:00:52.118086 7101 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_22762929a67d4e56be830cb18eaa2af8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 14:00:52.118712 7097 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_79e5262b7980424fbe659116c4785e9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 14:00:52.119537 7104 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2866c4520a3d40c4b3c6ca93424e5a0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 14:00:52.115620 7098 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d303c0450b934f2bb0f8ab01b92f2e67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 14:00:52.151597 7621 heartbeater.cc:646] Failed to heartbeat to 127.6.125.126:45121 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
W20260502 14:00:52.198107 7343 heartbeater.cc:646] Failed to heartbeat to 127.6.125.126:45121 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
W20260502 14:00:52.416703 7481 heartbeater.cc:646] Failed to heartbeat to 127.6.125.126:45121 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
W20260502 14:00:52.465003 7091 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
W20260502 14:00:52.466117 7091 consensus_peers.cc:597] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f -> Peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Couldn't send request to peer 9d590d630acd4892b59504b1c66c4f2d. Status: Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260502 14:00:52.573388 7103 catalog_manager.cc:2174] created HMS catalog entry for table [id=5f7ce7415f6e4ee19261effe9db10f86]
I20260502 14:00:52.574824 7044 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 3 FOLLOWER]: Refusing update from remote peer a5d257c30a994bfdb03242b10606426f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260502 14:00:52.575520 7496 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260502 14:00:52.587641 7496 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:52.587808 7496 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: LEADER
I20260502 14:00:52.592178 7676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5d257c30a994bfdb03242b10606426f. Latest consensus state: current_term: 3 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:52.592362 7676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:52.592463 7676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:52.598924 7103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.125.67:54143
I20260502 14:00:52.599160 7676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:52.610159 7103 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_6c9325cba2ed431fa72add0d6f4fb869" } new_table_name: "default.Table_0d20cbe3e06443a39d25177f4abb4de7" modify_external_catalogs: true
I20260502 14:00:52.617390 7105 catalog_manager.cc:2174] created HMS catalog entry for table [id=2e16fc53645e4ac09e94393928628f3e]
I20260502 14:00:52.633554 7105 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_5e304d38082c4c6baeee1789cc1d2de2" } new_table_name: "default.Table_f0b8f5be35da4f878de056348eefee40" modify_external_catalogs: true
I20260502 14:00:52.644665 7555 tablet_service.cc:1511] Processing CreateTablet for tablet 8310c91704af422ebdd03855376a5d44 (DEFAULT_TABLE table=default.table_6c9325cba2ed431fa72add0d6f4fb869 [id=5f7ce7415f6e4ee19261effe9db10f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.645438 7552 tablet_service.cc:1511] Processing CreateTablet for tablet 41766af78f284c9090a789262ad19c3c (DEFAULT_TABLE table=default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.646258 7552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41766af78f284c9090a789262ad19c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.648347 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8310c91704af422ebdd03855376a5d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.649897 7415 tablet_service.cc:1511] Processing CreateTablet for tablet 8310c91704af422ebdd03855376a5d44 (DEFAULT_TABLE table=default.table_6c9325cba2ed431fa72add0d6f4fb869 [id=5f7ce7415f6e4ee19261effe9db10f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.651181 7415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8310c91704af422ebdd03855376a5d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.654397 7277 tablet_service.cc:1511] Processing CreateTablet for tablet 8310c91704af422ebdd03855376a5d44 (DEFAULT_TABLE table=default.table_6c9325cba2ed431fa72add0d6f4fb869 [id=5f7ce7415f6e4ee19261effe9db10f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.655534 7277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8310c91704af422ebdd03855376a5d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.656196 7276 tablet_service.cc:1511] Processing CreateTablet for tablet 41766af78f284c9090a789262ad19c3c (DEFAULT_TABLE table=default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.656474 7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41766af78f284c9090a789262ad19c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.649905 7414 tablet_service.cc:1511] Processing CreateTablet for tablet 41766af78f284c9090a789262ad19c3c (DEFAULT_TABLE table=default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.660853 7414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41766af78f284c9090a789262ad19c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.668179 7691 tablet_bootstrap.cc:492] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:52.669106 7692 tablet_bootstrap.cc:492] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:52.670634 7691 tablet_bootstrap.cc:654] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.671378 7692 tablet_bootstrap.cc:654] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.671569 7691 log.cc:826] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62: Log is configured to *not* fsync() on all Append() calls
I20260502 14:00:52.672791 7692 log.cc:826] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84: Log is configured to *not* fsync() on all Append() calls
I20260502 14:00:52.673527 7691 tablet_bootstrap.cc:492] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:52.673534 7693 tablet_bootstrap.cc:492] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:52.673774 7691 ts_tablet_manager.cc:1403] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260502 14:00:52.676469 7693 tablet_bootstrap.cc:654] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.677572 7693 log.cc:826] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02: Log is configured to *not* fsync() on all Append() calls
I20260502 14:00:52.677853 7691 raft_consensus.cc:359] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.678119 7691 raft_consensus.cc:385] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.678181 7691 raft_consensus.cc:740] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.678766 7691 consensus_queue.cc:260] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.679720 7691 ts_tablet_manager.cc:1434] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260502 14:00:52.680087 7692 tablet_bootstrap.cc:492] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:52.680313 7692 ts_tablet_manager.cc:1403] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260502 14:00:52.680795 7100 catalog_manager.cc:2174] created HMS catalog entry for table [id=a4faee50852b47da98cc7526f3f29504]
I20260502 14:00:52.680881 7622 heartbeater.cc:499] Master 127.6.125.124:43159 was elected leader, sending a full tablet report...
I20260502 14:00:52.684516 7691 tablet_bootstrap.cc:492] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:52.685690 7691 tablet_bootstrap.cc:654] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.689203 7691 tablet_bootstrap.cc:492] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:52.689308 7691 ts_tablet_manager.cc:1403] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260502 14:00:52.689939 7691 raft_consensus.cc:359] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:52.690059 7691 raft_consensus.cc:385] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.690088 7691 raft_consensus.cc:740] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.690232 7691 consensus_queue.cc:260] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:52.690697 7691 ts_tablet_manager.cc:1434] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:52.693326 7277 tablet_service.cc:1511] Processing CreateTablet for tablet d4f8d4b7974c463b88ce9688073a5797 (DEFAULT_TABLE table=default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.693668 7277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f8d4b7974c463b88ce9688073a5797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.696928 7555 tablet_service.cc:1511] Processing CreateTablet for tablet d4f8d4b7974c463b88ce9688073a5797 (DEFAULT_TABLE table=default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.696954 7414 tablet_service.cc:1511] Processing CreateTablet for tablet d4f8d4b7974c463b88ce9688073a5797 (DEFAULT_TABLE table=default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.697212 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f8d4b7974c463b88ce9688073a5797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.697256 7414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f8d4b7974c463b88ce9688073a5797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.699509 7691 tablet_bootstrap.cc:492] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:52.700606 7691 tablet_bootstrap.cc:654] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.702670 7100 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_a373f862bd114b1090e1aeba01375597" } new_table_name: "default.Table_9c2adeda8ca24651b8be47c058c64d23" modify_external_catalogs: true
I20260502 14:00:52.703070 7691 tablet_bootstrap.cc:492] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:52.703167 7691 ts_tablet_manager.cc:1403] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 14:00:52.703657 7691 raft_consensus.cc:359] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.703789 7691 raft_consensus.cc:385] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.703824 7691 raft_consensus.cc:740] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.703972 7691 consensus_queue.cc:260] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.704231 7691 ts_tablet_manager.cc:1434] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 14:00:52.706892 7692 raft_consensus.cc:359] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:52.707252 7692 raft_consensus.cc:385] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.707366 7692 raft_consensus.cc:740] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.708002 7692 consensus_queue.cc:260] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:52.709535 7692 ts_tablet_manager.cc:1434] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.029s user 0.005s sys 0.000s
I20260502 14:00:52.710084 7692 tablet_bootstrap.cc:492] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:52.711280 7692 tablet_bootstrap.cc:654] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.713915 7693 tablet_bootstrap.cc:492] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:52.714327 7693 ts_tablet_manager.cc:1403] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.041s user 0.006s sys 0.000s
I20260502 14:00:52.710110 7482 heartbeater.cc:499] Master 127.6.125.124:43159 was elected leader, sending a full tablet report...
I20260502 14:00:52.718590 7693 raft_consensus.cc:359] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:52.718981 7693 raft_consensus.cc:385] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.719125 7693 raft_consensus.cc:740] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.719736 7693 consensus_queue.cc:260] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:52.720913 7693 ts_tablet_manager.cc:1434] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260502 14:00:52.722112 7344 heartbeater.cc:499] Master 127.6.125.124:43159 was elected leader, sending a full tablet report...
I20260502 14:00:52.723796 7693 tablet_bootstrap.cc:492] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:52.725236 7693 tablet_bootstrap.cc:654] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.726291 7692 tablet_bootstrap.cc:492] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:52.726703 7692 ts_tablet_manager.cc:1403] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.001s
I20260502 14:00:52.727741 7692 raft_consensus.cc:359] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.728067 7692 raft_consensus.cc:385] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.728168 7692 raft_consensus.cc:740] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.728437 7692 consensus_queue.cc:260] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.728832 7692 ts_tablet_manager.cc:1434] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260502 14:00:52.734192 7692 tablet_bootstrap.cc:492] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:52.735795 7692 tablet_bootstrap.cc:654] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.740804 7692 tablet_bootstrap.cc:492] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:52.741057 7692 ts_tablet_manager.cc:1403] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260502 14:00:52.741918 7692 raft_consensus.cc:359] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.742151 7692 raft_consensus.cc:385] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.742238 7692 raft_consensus.cc:740] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.742472 7692 consensus_queue.cc:260] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.745536 7692 ts_tablet_manager.cc:1434] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260502 14:00:52.748596 7693 tablet_bootstrap.cc:492] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:52.748713 7693 ts_tablet_manager.cc:1403] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.001s
I20260502 14:00:52.749460 7693 raft_consensus.cc:359] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.749588 7693 raft_consensus.cc:385] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.749619 7693 raft_consensus.cc:740] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.749958 7693 consensus_queue.cc:260] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.750329 7693 ts_tablet_manager.cc:1434] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 14:00:52.751510 7693 tablet_bootstrap.cc:492] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:52.753672 7693 tablet_bootstrap.cc:654] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.764896 7693 tablet_bootstrap.cc:492] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:52.765142 7693 ts_tablet_manager.cc:1403] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260502 14:00:52.766034 7693 raft_consensus.cc:359] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.766276 7693 raft_consensus.cc:385] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.766361 7693 raft_consensus.cc:740] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.766624 7693 consensus_queue.cc:260] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.768287 7693 ts_tablet_manager.cc:1434] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 14:00:52.772360 7701 raft_consensus.cc:493] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:52.772557 7701 raft_consensus.cc:515] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:52.773980 7701 leader_election.cc:290] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:52.778403 7101 catalog_manager.cc:2174] created HMS catalog entry for table [id=d99c8ace41cc4593aadfe92cd5fa1c16]
I20260502 14:00:52.780422 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8310c91704af422ebdd03855376a5d44" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:52.780753 7297 raft_consensus.cc:2468] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:52.781257 7368 leader_election.cc:304] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:52.781564 7701 raft_consensus.cc:2804] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:52.781634 7701 raft_consensus.cc:493] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:52.781674 7701 raft_consensus.cc:3060] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.782802 7701 raft_consensus.cc:515] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:52.783217 7701 leader_election.cc:290] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:52.783741 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8310c91704af422ebdd03855376a5d44" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:52.783876 7297 raft_consensus.cc:3060] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.785497 7297 raft_consensus.cc:2468] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:52.785888 7368 leader_election.cc:304] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:52.786073 7701 raft_consensus.cc:2804] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:52.786271 7701 raft_consensus.cc:697] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:00:52.786279 7101 master_service.cc:954] ReplaceTablet: received request to replace tablet 41766af78f284c9090a789262ad19c3c from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:52.786604 7701 consensus_queue.cc:237] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:52.807685 7277 tablet_service.cc:1511] Processing CreateTablet for tablet 22429e0ec4464a6c8499cb47aa4558fd (DEFAULT_TABLE table=default.table_22762929a67d4e56be830cb18eaa2af8 [id=d99c8ace41cc4593aadfe92cd5fa1c16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.808084 7277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22429e0ec4464a6c8499cb47aa4558fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.810590 7693 tablet_bootstrap.cc:492] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:52.811730 7693 tablet_bootstrap.cc:654] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.813661 7555 tablet_service.cc:1511] Processing CreateTablet for tablet 22429e0ec4464a6c8499cb47aa4558fd (DEFAULT_TABLE table=default.table_22762929a67d4e56be830cb18eaa2af8 [id=d99c8ace41cc4593aadfe92cd5fa1c16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.814007 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22429e0ec4464a6c8499cb47aa4558fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.816393 7414 tablet_service.cc:1511] Processing CreateTablet for tablet 22429e0ec4464a6c8499cb47aa4558fd (DEFAULT_TABLE table=default.table_22762929a67d4e56be830cb18eaa2af8 [id=d99c8ace41cc4593aadfe92cd5fa1c16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.816726 7414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22429e0ec4464a6c8499cb47aa4558fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.819095 7692 tablet_bootstrap.cc:492] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:52.820325 7692 tablet_bootstrap.cc:654] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.822118 7691 tablet_bootstrap.cc:492] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:52.823462 7691 tablet_bootstrap.cc:654] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.823845 7101 catalog_manager.cc:5958] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Sending DeleteTablet for 3 replicas of tablet 41766af78f284c9090a789262ad19c3c
I20260502 14:00:52.824689 7277 tablet_service.cc:1558] Processing DeleteTablet for tablet 41766af78f284c9090a789262ad19c3c with delete_type TABLET_DATA_DELETED (replaced by tablet e14a927cc21141f389ff5fe174b0225a) from {username='slave'} at 127.0.0.1:44408
I20260502 14:00:52.828644 7101 catalog_manager.cc:6741] ReplaceTablet: tablet 41766af78f284c9090a789262ad19c3c deleted and replaced by tablet e14a927cc21141f389ff5fe174b0225a
I20260502 14:00:52.829746 7414 tablet_service.cc:1558] Processing DeleteTablet for tablet 41766af78f284c9090a789262ad19c3c with delete_type TABLET_DATA_DELETED (replaced by tablet e14a927cc21141f389ff5fe174b0225a) from {username='slave'} at 127.0.0.1:43518
I20260502 14:00:52.830385 7555 tablet_service.cc:1558] Processing DeleteTablet for tablet 41766af78f284c9090a789262ad19c3c with delete_type TABLET_DATA_DELETED (replaced by tablet e14a927cc21141f389ff5fe174b0225a) from {username='slave'} at 127.0.0.1:58268
I20260502 14:00:52.832171 7697 raft_consensus.cc:493] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:52.832408 7697 raft_consensus.cc:515] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.833894 7697 leader_election.cc:290] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:52.836179 7691 tablet_bootstrap.cc:492] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:52.836284 7691 ts_tablet_manager.cc:1403] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260502 14:00:52.836779 7691 raft_consensus.cc:359] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.836911 7691 raft_consensus.cc:385] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.836949 7691 raft_consensus.cc:740] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.837074 7691 consensus_queue.cc:260] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.837055 7414 tablet_service.cc:1511] Processing CreateTablet for tablet e14a927cc21141f389ff5fe174b0225a (DEFAULT_TABLE table=default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.837361 7691 ts_tablet_manager.cc:1434] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 14:00:52.837395 7414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14a927cc21141f389ff5fe174b0225a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.840163 7277 tablet_service.cc:1511] Processing CreateTablet for tablet e14a927cc21141f389ff5fe174b0225a (DEFAULT_TABLE table=default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.840516 7277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14a927cc21141f389ff5fe174b0225a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.842350 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f8d4b7974c463b88ce9688073a5797" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:52.842523 7297 raft_consensus.cc:2468] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:52.843115 7508 leader_election.cc:304] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:52.843422 7697 raft_consensus.cc:2804] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:52.843488 7697 raft_consensus.cc:493] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:52.843523 7697 raft_consensus.cc:3060] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.843856 7555 tablet_service.cc:1511] Processing CreateTablet for tablet e14a927cc21141f389ff5fe174b0225a (DEFAULT_TABLE table=default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.844223 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14a927cc21141f389ff5fe174b0225a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.844623 7697 raft_consensus.cc:515] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.845036 7697 leader_election.cc:290] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:52.845786 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f8d4b7974c463b88ce9688073a5797" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:52.846002 7297 raft_consensus.cc:3060] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.846730 7691 tablet_bootstrap.cc:492] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:52.847069 7297 raft_consensus.cc:2468] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:52.847476 7508 leader_election.cc:304] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:52.847769 7697 raft_consensus.cc:2804] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:52.847918 7697 raft_consensus.cc:697] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:00:52.848259 7697 consensus_queue.cc:237] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.847782 7691 tablet_bootstrap.cc:654] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.856051 7435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f8d4b7974c463b88ce9688073a5797" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:52.856307 7435 raft_consensus.cc:2468] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:52.856587 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f8d4b7974c463b88ce9688073a5797" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:52.856715 7434 raft_consensus.cc:3060] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.856925 7101 catalog_manager.cc:5671] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66). New cstate: current_term: 1 leader_uuid: "1be1472a04ae46e48d852d66903d9c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } }
I20260502 14:00:52.857470 7701 raft_consensus.cc:493] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:52.857547 7701 raft_consensus.cc:515] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.857831 7434 raft_consensus.cc:2468] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:52.857899 7701 leader_election.cc:290] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:52.858405 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41766af78f284c9090a789262ad19c3c" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:52.858537 7297 raft_consensus.cc:2468] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:52.858824 7368 leader_election.cc:304] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:52.858996 7701 raft_consensus.cc:2804] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:52.859038 7701 raft_consensus.cc:493] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:52.859069 7701 raft_consensus.cc:3060] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.859591 7691 tablet_bootstrap.cc:492] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:52.859686 7691 ts_tablet_manager.cc:1403] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20260502 14:00:52.860002 7701 raft_consensus.cc:515] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.860244 7691 raft_consensus.cc:359] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.860364 7691 raft_consensus.cc:385] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.860355 7701 leader_election.cc:290] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:52.860399 7691 raft_consensus.cc:740] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.860513 7691 consensus_queue.cc:260] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.860780 7691 ts_tablet_manager.cc:1434] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:52.861215 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41766af78f284c9090a789262ad19c3c" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:52.861362 7297 raft_consensus.cc:3060] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.862358 7297 raft_consensus.cc:2468] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:52.862649 7368 leader_election.cc:304] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:52.862959 7701 raft_consensus.cc:2804] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:52.863036 7701 raft_consensus.cc:697] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:00:52.863165 7701 consensus_queue.cc:237] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.866834 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41766af78f284c9090a789262ad19c3c" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:52.867008 7575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8310c91704af422ebdd03855376a5d44" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:52.867051 7572 raft_consensus.cc:3060] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.867161 7575 raft_consensus.cc:2468] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:52.867424 7573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41766af78f284c9090a789262ad19c3c" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:52.867950 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8310c91704af422ebdd03855376a5d44" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:52.868055 7574 raft_consensus.cc:3060] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.868181 7572 raft_consensus.cc:2468] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:52.868976 7574 raft_consensus.cc:2468] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:52.875798 7101 catalog_manager.cc:5671] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67). New cstate: current_term: 1 leader_uuid: "c2964848cb1648a4bc2c1d671cc54f62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: HEALTHY } } }
I20260502 14:00:52.876883 7693 tablet_bootstrap.cc:492] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:52.877002 7693 ts_tablet_manager.cc:1403] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.066s user 0.000s sys 0.002s
I20260502 14:00:52.877532 7693 raft_consensus.cc:359] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.877645 7693 raft_consensus.cc:385] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.877677 7693 raft_consensus.cc:740] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.877826 7693 consensus_queue.cc:260] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.878127 7693 ts_tablet_manager.cc:1434] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 14:00:52.878341 7693 tablet_bootstrap.cc:492] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:52.879485 7693 tablet_bootstrap.cc:654] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.880312 7713 tablet_replica.cc:333] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:52.880641 7713 raft_consensus.cc:2243] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:52.880927 7713 raft_consensus.cc:2272] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:52.883036 7692 tablet_bootstrap.cc:492] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:52.883036 7715 tablet_replica.cc:333] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:00:52.883160 7692 ts_tablet_manager.cc:1403] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.000s
I20260502 14:00:52.883492 7714 tablet_replica.cc:333] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:52.883795 7714 raft_consensus.cc:2243] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:52.884179 7714 pending_rounds.cc:70] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84: Trying to abort 1 pending ops.
I20260502 14:00:52.884275 7714 pending_rounds.cc:77] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281583934928936960 op_type: NO_OP noop_request { }
I20260502 14:00:52.884380 7714 raft_consensus.cc:2889] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260502 14:00:52.884454 7714 raft_consensus.cc:2272] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:52.883798 7692 raft_consensus.cc:359] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.884513 7692 raft_consensus.cc:385] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.884541 7692 raft_consensus.cc:740] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.884663 7692 consensus_queue.cc:260] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.884922 7692 ts_tablet_manager.cc:1434] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 14:00:52.885118 7692 tablet_bootstrap.cc:492] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:52.886268 7692 tablet_bootstrap.cc:654] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
W20260502 14:00:52.889407 7624 tablet.cc:2404] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260502 14:00:52.892098 7715 raft_consensus.cc:2243] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:52.892364 7715 raft_consensus.cc:2272] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:52.894870 7715 ts_tablet_manager.cc:1916] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260502 14:00:52.895826 7484 tablet.cc:2404] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260502 14:00:52.896495 7697 raft_consensus.cc:493] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:52.896595 7697 raft_consensus.cc:515] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.896989 7697 leader_election.cc:290] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:52.897795 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22429e0ec4464a6c8499cb47aa4558fd" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:52.897936 7434 raft_consensus.cc:2468] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:52.898226 7511 leader_election.cc:304] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:52.898387 7697 raft_consensus.cc:2804] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:52.898440 7697 raft_consensus.cc:493] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:52.898485 7697 raft_consensus.cc:3060] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.899493 7697 raft_consensus.cc:515] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.899873 7697 leader_election.cc:290] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:52.900419 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22429e0ec4464a6c8499cb47aa4558fd" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:52.900563 7296 raft_consensus.cc:3060] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.901635 7296 raft_consensus.cc:2468] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:52.902068 7508 leader_election.cc:304] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:52.902499 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22429e0ec4464a6c8499cb47aa4558fd" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:52.902639 7434 raft_consensus.cc:3060] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.903641 7434 raft_consensus.cc:2468] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:52.903647 7713 ts_tablet_manager.cc:1916] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:52.904349 7697 raft_consensus.cc:2804] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:52.904161 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22429e0ec4464a6c8499cb47aa4558fd" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:52.904549 7297 raft_consensus.cc:2376] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1. Re-sending same reply.
I20260502 14:00:52.904621 7697 raft_consensus.cc:697] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:00:52.904767 7697 consensus_queue.cc:237] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.908682 7692 tablet_bootstrap.cc:492] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:52.908805 7692 ts_tablet_manager.cc:1403] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20260502 14:00:52.909053 7714 ts_tablet_manager.cc:1916] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:52.909301 7692 raft_consensus.cc:359] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.909413 7692 raft_consensus.cc:385] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.909452 7692 raft_consensus.cc:740] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.909581 7692 consensus_queue.cc:260] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.909901 7692 ts_tablet_manager.cc:1434] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:52.912075 7097 catalog_manager.cc:2174] created HMS catalog entry for table [id=2b961b00f8804350ade31c5ac13105e3]
I20260502 14:00:52.916570 7101 master_service.cc:954] ReplaceTablet: received request to replace tablet 41766af78f284c9090a789262ad19c3c from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:52.916674 7097 catalog_manager.cc:5671] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67). New cstate: current_term: 1 leader_uuid: "c2964848cb1648a4bc2c1d671cc54f62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: HEALTHY } } }
I20260502 14:00:52.916916 7101 master_service.cc:954] ReplaceTablet: received request to replace tablet d4f8d4b7974c463b88ce9688073a5797 from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:52.917043 7714 ts_tablet_manager.cc:1929] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:52.917133 7714 log.cc:1199] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/41766af78f284c9090a789262ad19c3c
I20260502 14:00:52.917433 7714 ts_tablet_manager.cc:1950] T 41766af78f284c9090a789262ad19c3c P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:52.915786 7715 ts_tablet_manager.cc:1929] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260502 14:00:52.918092 7715 log.cc:1199] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/41766af78f284c9090a789262ad19c3c
I20260502 14:00:52.918211 7713 ts_tablet_manager.cc:1929] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260502 14:00:52.918298 7713 log.cc:1199] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/41766af78f284c9090a789262ad19c3c
I20260502 14:00:52.918363 7715 ts_tablet_manager.cc:1950] T 41766af78f284c9090a789262ad19c3c P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:00:52.918818 7713 ts_tablet_manager.cc:1950] T 41766af78f284c9090a789262ad19c3c P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:52.920960 7090 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet 41766af78f284c9090a789262ad19c3c (table default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e]) successfully deleted
I20260502 14:00:52.921361 7693 tablet_bootstrap.cc:492] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:52.921473 7693 ts_tablet_manager.cc:1403] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.000s
I20260502 14:00:52.922048 7693 raft_consensus.cc:359] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.922164 7693 raft_consensus.cc:385] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.922195 7693 raft_consensus.cc:740] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.922322 7693 consensus_queue.cc:260] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.922602 7093 catalog_manager.cc:5002] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): tablet 41766af78f284c9090a789262ad19c3c (table default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e]) successfully deleted
I20260502 14:00:52.922984 7093 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet 41766af78f284c9090a789262ad19c3c (table default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e]) successfully deleted
I20260502 14:00:52.924897 7693 ts_tablet_manager.cc:1434] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
W20260502 14:00:52.933917 7346 tablet.cc:2404] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260502 14:00:52.934005 7097 master_service.cc:954] ReplaceTablet: received request to replace tablet 41766af78f284c9090a789262ad19c3c from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:52.934314 7097 master_service.cc:954] ReplaceTablet: received request to replace tablet d4f8d4b7974c463b88ce9688073a5797 from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:52.942639 7101 catalog_manager.cc:5958] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Sending DeleteTablet for 3 replicas of tablet d4f8d4b7974c463b88ce9688073a5797
I20260502 14:00:52.942972 7101 catalog_manager.cc:6741] ReplaceTablet: tablet d4f8d4b7974c463b88ce9688073a5797 deleted and replaced by tablet 429294b843b744caa11ea0b4ab3c6067
I20260502 14:00:52.944455 7101 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_22762929a67d4e56be830cb18eaa2af8" } new_table_name: "default.Table_da5e1cd539c94420b562a58316eecee9" modify_external_catalogs: true
I20260502 14:00:52.945191 7097 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_4534fe13c1d94c399d9c725c85deb6d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:52.946810 7277 tablet_service.cc:1558] Processing DeleteTablet for tablet d4f8d4b7974c463b88ce9688073a5797 with delete_type TABLET_DATA_DELETED (replaced by tablet 429294b843b744caa11ea0b4ab3c6067) from {username='slave'} at 127.0.0.1:44408
I20260502 14:00:52.947145 7276 tablet_service.cc:1511] Processing CreateTablet for tablet 87287e19be8043d79878f64ba123b3eb (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.947501 7415 tablet_service.cc:1511] Processing CreateTablet for tablet 87287e19be8043d79878f64ba123b3eb (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.947734 7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87287e19be8043d79878f64ba123b3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.948021 7415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87287e19be8043d79878f64ba123b3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.948071 7414 tablet_service.cc:1558] Processing DeleteTablet for tablet d4f8d4b7974c463b88ce9688073a5797 with delete_type TABLET_DATA_DELETED (replaced by tablet 429294b843b744caa11ea0b4ab3c6067) from {username='slave'} at 127.0.0.1:43518
I20260502 14:00:52.948226 7714 tablet_replica.cc:333] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:52.948334 7714 raft_consensus.cc:2243] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:52.948441 7714 raft_consensus.cc:2272] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:52.948434 7552 tablet_service.cc:1511] Processing CreateTablet for tablet 87287e19be8043d79878f64ba123b3eb (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.948684 7552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87287e19be8043d79878f64ba123b3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.950902 7691 tablet_bootstrap.cc:492] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:52.950929 7714 ts_tablet_manager.cc:1916] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:52.955253 7691 tablet_bootstrap.cc:654] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.955825 7714 ts_tablet_manager.cc:1929] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260502 14:00:52.955947 7714 log.cc:1199] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/d4f8d4b7974c463b88ce9688073a5797
I20260502 14:00:52.956158 7714 ts_tablet_manager.cc:1950] T d4f8d4b7974c463b88ce9688073a5797 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:52.957067 7093 catalog_manager.cc:5002] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): tablet d4f8d4b7974c463b88ce9688073a5797 (table default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]) successfully deleted
I20260502 14:00:52.957347 7693 tablet_bootstrap.cc:492] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:52.957829 7555 tablet_service.cc:1558] Processing DeleteTablet for tablet d4f8d4b7974c463b88ce9688073a5797 with delete_type TABLET_DATA_DELETED (replaced by tablet 429294b843b744caa11ea0b4ab3c6067) from {username='slave'} at 127.0.0.1:58268
I20260502 14:00:52.958016 7715 tablet_replica.cc:333] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:00:52.958138 7715 raft_consensus.cc:2243] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:52.958405 7715 pending_rounds.cc:70] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62: Trying to abort 1 pending ops.
I20260502 14:00:52.958520 7715 pending_rounds.cc:77] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281583934895378432 op_type: NO_OP noop_request { }
I20260502 14:00:52.958645 7715 raft_consensus.cc:2889] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260502 14:00:52.958719 7715 raft_consensus.cc:2272] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:52.958945 7692 tablet_bootstrap.cc:492] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:52.959548 7715 ts_tablet_manager.cc:1916] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:52.960045 7692 tablet_bootstrap.cc:654] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.961890 7693 tablet_bootstrap.cc:654] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.962579 7715 ts_tablet_manager.cc:1929] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:52.962651 7715 log.cc:1199] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/d4f8d4b7974c463b88ce9688073a5797
I20260502 14:00:52.962865 7715 ts_tablet_manager.cc:1950] T d4f8d4b7974c463b88ce9688073a5797 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:00:52.963104 7555 tablet_service.cc:1511] Processing CreateTablet for tablet 429294b843b744caa11ea0b4ab3c6067 (DEFAULT_TABLE table=default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.963380 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429294b843b744caa11ea0b4ab3c6067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.963631 7713 tablet_replica.cc:333] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:52.963930 7713 raft_consensus.cc:2243] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:52.964072 7713 raft_consensus.cc:2272] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:52.964797 7691 tablet_bootstrap.cc:492] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:52.964892 7691 ts_tablet_manager.cc:1403] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20260502 14:00:52.965416 7691 raft_consensus.cc:359] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.965523 7691 raft_consensus.cc:385] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.965551 7691 raft_consensus.cc:740] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.965683 7691 consensus_queue.cc:260] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.965832 7093 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet d4f8d4b7974c463b88ce9688073a5797 (table default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]) successfully deleted
I20260502 14:00:52.965901 7692 tablet_bootstrap.cc:492] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:52.965979 7691 ts_tablet_manager.cc:1434] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260502 14:00:52.965994 7692 ts_tablet_manager.cc:1403] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260502 14:00:52.966038 7415 tablet_service.cc:1511] Processing CreateTablet for tablet 429294b843b744caa11ea0b4ab3c6067 (DEFAULT_TABLE table=default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.966320 7415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429294b843b744caa11ea0b4ab3c6067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.966447 7692 raft_consensus.cc:359] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.966560 7692 raft_consensus.cc:385] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.966607 7692 raft_consensus.cc:740] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.966744 7692 consensus_queue.cc:260] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.967022 7692 ts_tablet_manager.cc:1434] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:00:52.968387 7276 tablet_service.cc:1511] Processing CreateTablet for tablet 429294b843b744caa11ea0b4ab3c6067 (DEFAULT_TABLE table=default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:52.968690 7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429294b843b744caa11ea0b4ab3c6067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:52.968987 7693 tablet_bootstrap.cc:492] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:52.969074 7693 ts_tablet_manager.cc:1403] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20260502 14:00:52.969528 7693 raft_consensus.cc:359] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.969627 7693 raft_consensus.cc:385] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.969653 7693 raft_consensus.cc:740] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.969774 7693 consensus_queue.cc:260] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.970510 7691 tablet_bootstrap.cc:492] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:52.971688 7692 tablet_bootstrap.cc:492] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:52.971786 7691 tablet_bootstrap.cc:654] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.972302 7713 ts_tablet_manager.cc:1916] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:52.972816 7692 tablet_bootstrap.cc:654] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.974735 7693 ts_tablet_manager.cc:1434] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260502 14:00:52.976042 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--webserver_interface=127.6.125.126
--webserver_port=39397
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260502 14:00:52.976909 7713 ts_tablet_manager.cc:1929] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260502 14:00:52.976990 7713 log.cc:1199] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/d4f8d4b7974c463b88ce9688073a5797
I20260502 14:00:52.977268 7713 ts_tablet_manager.cc:1950] T d4f8d4b7974c463b88ce9688073a5797 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:52.978680 7693 tablet_bootstrap.cc:492] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:52.979847 7693 tablet_bootstrap.cc:654] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:52.981022 7090 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet d4f8d4b7974c463b88ce9688073a5797 (table default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]) successfully deleted
I20260502 14:00:52.981550 7692 tablet_bootstrap.cc:492] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:52.981765 7692 ts_tablet_manager.cc:1403] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260502 14:00:52.981930 7691 tablet_bootstrap.cc:492] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:52.982033 7691 ts_tablet_manager.cc:1403] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260502 14:00:52.982486 7692 raft_consensus.cc:359] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.982743 7692 raft_consensus.cc:385] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.982745 7691 raft_consensus.cc:359] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.982800 7692 raft_consensus.cc:740] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.982863 7691 raft_consensus.cc:385] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.982892 7691 raft_consensus.cc:740] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.983008 7692 consensus_queue.cc:260] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.983088 7691 consensus_queue.cc:260] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.983352 7692 ts_tablet_manager.cc:1434] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 14:00:52.984318 7708 raft_consensus.cc:493] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:52.984403 7708 raft_consensus.cc:515] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.984790 7708 leader_election.cc:290] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:52.985886 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14a927cc21141f389ff5fe174b0225a" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:52.986038 7574 raft_consensus.cc:2468] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:52.986392 7371 leader_election.cc:304] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:52.986580 7708 raft_consensus.cc:2804] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:52.986627 7708 raft_consensus.cc:493] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:52.986662 7708 raft_consensus.cc:3060] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.986779 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14a927cc21141f389ff5fe174b0225a" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:52.986931 7297 raft_consensus.cc:2468] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:52.987737 7708 raft_consensus.cc:515] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.988245 7708 leader_election.cc:290] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:52.989840 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14a927cc21141f389ff5fe174b0225a" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:52.989974 7297 raft_consensus.cc:3060] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.990002 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14a927cc21141f389ff5fe174b0225a" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:52.990127 7574 raft_consensus.cc:3060] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:52.990703 7693 tablet_bootstrap.cc:492] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:52.990794 7693 ts_tablet_manager.cc:1403] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260502 14:00:52.990999 7297 raft_consensus.cc:2468] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:52.991016 7574 raft_consensus.cc:2468] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:52.991307 7693 raft_consensus.cc:359] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.991345 7371 leader_election.cc:304] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:52.991410 7693 raft_consensus.cc:385] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:52.991438 7693 raft_consensus.cc:740] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:52.991570 7693 consensus_queue.cc:260] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.991643 7708 raft_consensus.cc:2804] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:52.991715 7708 raft_consensus.cc:697] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:00:52.991851 7708 consensus_queue.cc:237] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:52.990017 7691 ts_tablet_manager.cc:1434] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260502 14:00:52.995779 7693 ts_tablet_manager.cc:1434] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260502 14:00:53.066843 7106 catalog_manager.cc:2174] created HMS catalog entry for table [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]
I20260502 14:00:53.067008 7708 raft_consensus.cc:493] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:53.067140 7708 raft_consensus.cc:515] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.067647 7708 leader_election.cc:290] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:53.068593 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429294b843b744caa11ea0b4ab3c6067" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:53.068756 7297 raft_consensus.cc:2468] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:53.069025 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429294b843b744caa11ea0b4ab3c6067" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:53.069159 7574 raft_consensus.cc:2468] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:53.069573 7371 leader_election.cc:304] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:53.070048 7708 raft_consensus.cc:2804] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:53.070114 7708 raft_consensus.cc:493] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:53.070163 7708 raft_consensus.cc:3060] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.071303 7708 raft_consensus.cc:515] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.071738 7708 leader_election.cc:290] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:53.072477 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429294b843b744caa11ea0b4ab3c6067" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:53.072626 7574 raft_consensus.cc:3060] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.073740 7574 raft_consensus.cc:2468] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:53.074534 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429294b843b744caa11ea0b4ab3c6067" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:53.074673 7297 raft_consensus.cc:3060] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.075729 7297 raft_consensus.cc:2468] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:53.076169 7371 leader_election.cc:304] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:53.076668 7708 raft_consensus.cc:2804] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:53.076766 7708 raft_consensus.cc:697] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:00:53.076902 7708 consensus_queue.cc:237] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.081077 7106 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_ceee0100290949a6bc0c7926ef8c981e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:53.082250 7276 tablet_service.cc:1511] Processing CreateTablet for tablet 282c00536e1e4a708c32917582038281 (DEFAULT_TABLE table=default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.082542 7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282c00536e1e4a708c32917582038281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.084933 7693 tablet_bootstrap.cc:492] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:53.086387 7693 tablet_bootstrap.cc:654] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.087553 7415 tablet_service.cc:1511] Processing CreateTablet for tablet 282c00536e1e4a708c32917582038281 (DEFAULT_TABLE table=default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.087869 7415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282c00536e1e4a708c32917582038281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.090279 7555 tablet_service.cc:1511] Processing CreateTablet for tablet 282c00536e1e4a708c32917582038281 (DEFAULT_TABLE table=default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.090576 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282c00536e1e4a708c32917582038281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.092844 7692 tablet_bootstrap.cc:492] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:53.094173 7692 tablet_bootstrap.cc:654] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.095139 7691 tablet_bootstrap.cc:492] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:53.096433 7691 tablet_bootstrap.cc:654] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.105218 7692 tablet_bootstrap.cc:492] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:53.105355 7692 ts_tablet_manager.cc:1403] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.001s
I20260502 14:00:53.106241 7692 raft_consensus.cc:359] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.106416 7692 raft_consensus.cc:385] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.106462 7692 raft_consensus.cc:740] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.106746 7692 consensus_queue.cc:260] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.107178 7692 ts_tablet_manager.cc:1434] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260502 14:00:53.110852 7691 tablet_bootstrap.cc:492] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:53.111006 7691 ts_tablet_manager.cc:1403] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260502 14:00:53.111586 7691 raft_consensus.cc:359] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.111730 7691 raft_consensus.cc:385] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.111769 7691 raft_consensus.cc:740] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.112066 7691 consensus_queue.cc:260] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.112633 7691 ts_tablet_manager.cc:1434] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260502 14:00:53.114248 7693 tablet_bootstrap.cc:492] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:53.114383 7693 ts_tablet_manager.cc:1403] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.002s
I20260502 14:00:53.114938 7693 raft_consensus.cc:359] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.115082 7693 raft_consensus.cc:385] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.115123 7693 raft_consensus.cc:740] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.115262 7693 consensus_queue.cc:260] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.115542 7693 ts_tablet_manager.cc:1434] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260502 14:00:53.173844 7104 catalog_manager.cc:2174] created HMS catalog entry for table [id=a6606215bcc24f789f81868248dcd065]
I20260502 14:00:53.180527 7104 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47700 (request call id 29) took 1108 ms. Trace:
I20260502 14:00:53.180647 7104 rpcz_store.cc:276] 0502 14:00:52.072201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:52.072952 (+ 751us) service_pool.cc:224] Handling call
0502 14:00:52.119616 (+ 46664us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 14:00:52.119852 (+ 236us) catalog_manager.cc:2147] Created new table and tablet info
0502 14:00:53.173832 (+1053980us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 14:00:53.180310 (+ 6478us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 14:00:53.180424 (+ 114us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 14:00:53.180509 (+ 85us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 14:00:53.174865 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 14:00:53.174981 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0502 14:00:53.174986 (+ 5us) write_op.cc:435] Acquired schema lock
0502 14:00:53.174987 (+ 1us) tablet.cc:662] Decoding operations
0502 14:00:53.175058 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0502 14:00:53.175068 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0502 14:00:53.175071 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0502 14:00:53.175128 (+ 57us) tablet.cc:701] Row locks acquired
0502 14:00:53.175130 (+ 2us) write_op.cc:260] PREPARE: finished
0502 14:00:53.175174 (+ 44us) write_op.cc:270] Start()
0502 14:00:53.175204 (+ 30us) write_op.cc:276] Timestamp: P: 1777730453175151 usec, L: 0
0502 14:00:53.175206 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 14:00:53.175356 (+ 150us) log.cc:844] Serialized 432 byte log entry
0502 14:00:53.178232 (+ 2876us) op_driver.cc:464] REPLICATION: finished
0502 14:00:53.178321 (+ 89us) write_op.cc:301] APPLY: starting
0502 14:00:53.178335 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0502 14:00:53.178365 (+ 30us) tablet.cc:1370] finished BulkCheckPresence
0502 14:00:53.178379 (+ 14us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 14:00:53.178455 (+ 76us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 14:00:53.178484 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 14:00:53.178488 (+ 4us) write_op.cc:312] APPLY: finished
0502 14:00:53.178560 (+ 72us) log.cc:844] Serialized 28 byte log entry
0502 14:00:53.178607 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:53.178624 (+ 17us) write_op.cc:454] Released schema lock
0502 14:00:53.178629 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0502 14:00:53.178683 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:53.178685 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":946723,"Hive Metastore.run_cpu_time_us":211,"Hive Metastore.run_wall_time_us":107009,"spinlock_wait_cycles":1280,"child_traces":[["op",{"apply.queue_time_us":52,"apply.run_cpu_time_us":354,"apply.run_wall_time_us":353,"num_ops":2,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":582,"prepare.run_wall_time_us":584,"raft.queue_time_us":1034,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":227,"replication_time_us":3001}]]}
W20260502 14:00:53.186403 7730 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:00:53.187114 7730 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:00:53.187253 7730 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260502 14:00:53.190454 7276 tablet_service.cc:1511] Processing CreateTablet for tablet b93fca88135c47ddb518e4422d97a601 (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.190778 7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93fca88135c47ddb518e4422d97a601. 1 dirs total, 0 dirs full, 0 dirs failed
W20260502 14:00:53.192412 7730 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 14:00:53.192473 7730 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:00:53.192500 7730 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 14:00:53.192524 7730 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 14:00:53.193081 7693 tablet_bootstrap.cc:492] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:53.194097 7693 tablet_bootstrap.cc:654] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.196442 7415 tablet_service.cc:1511] Processing CreateTablet for tablet b93fca88135c47ddb518e4422d97a601 (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.196442 7555 tablet_service.cc:1511] Processing CreateTablet for tablet b93fca88135c47ddb518e4422d97a601 (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.196751 7415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93fca88135c47ddb518e4422d97a601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.196751 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93fca88135c47ddb518e4422d97a601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.198801 7730 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.125.126
--webserver_port=39397
--never_fsync=true
--heap_profile_path=/tmp/kudu.7730
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:00:53.199225 7691 tablet_bootstrap.cc:492] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:53.200039 7692 tablet_bootstrap.cc:492] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:53.200213 7730 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:00:53.201264 7692 tablet_bootstrap.cc:654] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.201566 7730 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260502 14:00:53.202587 7691 tablet_bootstrap.cc:654] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.203584 7104 catalog_manager.cc:5671] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66). New cstate: current_term: 1 leader_uuid: "1be1472a04ae46e48d852d66903d9c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: UNKNOWN } } }
I20260502 14:00:53.204058 7104 catalog_manager.cc:5671] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66). New cstate: current_term: 1 leader_uuid: "1be1472a04ae46e48d852d66903d9c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: UNKNOWN } } }
I20260502 14:00:53.206539 7693 tablet_bootstrap.cc:492] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:53.206643 7693 ts_tablet_manager.cc:1403] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.001s
I20260502 14:00:53.207093 7693 raft_consensus.cc:359] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.207192 7693 raft_consensus.cc:385] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.207217 7693 raft_consensus.cc:740] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.207331 7693 consensus_queue.cc:260] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.207530 7691 tablet_bootstrap.cc:492] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:53.207587 7693 ts_tablet_manager.cc:1434] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:53.207626 7691 ts_tablet_manager.cc:1403] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260502 14:00:53.208148 7691 raft_consensus.cc:359] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.208254 7691 raft_consensus.cc:385] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.208287 7691 raft_consensus.cc:740] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.208451 7691 consensus_queue.cc:260] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
W20260502 14:00:53.208575 7748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:00:53.208752 7691 ts_tablet_manager.cc:1434] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:53.209487 7692 tablet_bootstrap.cc:492] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:53.209590 7692 ts_tablet_manager.cc:1403] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260502 14:00:53.210070 7692 raft_consensus.cc:359] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.210186 7692 raft_consensus.cc:385] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.210217 7692 raft_consensus.cc:740] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.210330 7692 consensus_queue.cc:260] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.210601 7692 ts_tablet_manager.cc:1434] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260502 14:00:53.212663 7746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:00:53.214687 7730 server_base.cc:1061] running on GCE node
I20260502 14:00:53.214730 7708 consensus_queue.cc:1048] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 14:00:53.220073 7745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:00:53.221591 7730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:00:53.222872 7730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:00:53.223752 7701 consensus_queue.cc:1048] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.228121 7699 raft_consensus.cc:493] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:53.228243 7699 raft_consensus.cc:515] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.228709 7699 leader_election.cc:290] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:53.229332 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87287e19be8043d79878f64ba123b3eb" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:53.229472 7297 raft_consensus.cc:2468] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:53.229992 7508 leader_election.cc:304] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:53.230015 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87287e19be8043d79878f64ba123b3eb" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:53.230157 7699 raft_consensus.cc:2804] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:53.230163 7434 raft_consensus.cc:2468] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:53.230207 7699 raft_consensus.cc:493] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:53.230247 7699 raft_consensus.cc:3060] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.231367 7699 raft_consensus.cc:515] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.231731 7699 leader_election.cc:290] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:53.232308 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87287e19be8043d79878f64ba123b3eb" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:53.232442 7434 raft_consensus.cc:3060] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.232452 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87287e19be8043d79878f64ba123b3eb" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:53.232589 7297 raft_consensus.cc:3060] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.233477 7434 raft_consensus.cc:2468] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:53.233522 7297 raft_consensus.cc:2468] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:53.233892 7508 leader_election.cc:304] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:53.235076 7699 raft_consensus.cc:2804] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:53.235174 7699 raft_consensus.cc:697] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:00:53.235307 7699 consensus_queue.cc:237] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
W20260502 14:00:53.238170 7099 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0912854d0fb44cf69bf731fbb257be24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260502 14:00:53.241190 7730 hybrid_clock.cc:648] HybridClock initialized: now 1777730453240922 us; error 274 us; skew 500 ppm
I20260502 14:00:53.241242 7104 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_5bbf52ba925f45dfae2bee0f411a0316"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:53.244001 7730 webserver.cc:492] Webserver started at http://127.6.125.126:39397/ using document root <none> and password file <none>
I20260502 14:00:53.244808 7730 fs_manager.cc:362] Metadata directory not provided
I20260502 14:00:53.244903 7730 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:00:53.265529 7730 fs_manager.cc:714] Time spent opening directory manager: real 0.018s user 0.003s sys 0.000s
I20260502 14:00:53.275758 7760 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:00:53.278596 7730 fs_manager.cc:730] Time spent opening block manager: real 0.012s user 0.004s sys 0.000s
I20260502 14:00:53.278915 7730 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
uuid: "9d590d630acd4892b59504b1c66c4f2d"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:00:53.279686 7730 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:00:53.280478 7102 catalog_manager.cc:2174] created HMS catalog entry for table [id=5827a943881f4a9c817c1de3bfea409a]
I20260502 14:00:53.286372 7102 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47700 (request call id 25) took 1214 ms. Trace:
I20260502 14:00:53.286470 7102 rpcz_store.cc:276] 0502 14:00:52.071886 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:52.072292 (+ 406us) service_pool.cc:224] Handling call
0502 14:00:52.116112 (+ 43820us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 14:00:52.120669 (+ 4557us) catalog_manager.cc:2147] Created new table and tablet info
0502 14:00:53.280468 (+1159799us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 14:00:53.286160 (+ 5692us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 14:00:53.286261 (+ 101us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 14:00:53.286349 (+ 88us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 14:00:53.281211 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 14:00:53.281318 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0502 14:00:53.281322 (+ 4us) write_op.cc:435] Acquired schema lock
0502 14:00:53.281324 (+ 2us) tablet.cc:662] Decoding operations
0502 14:00:53.281393 (+ 69us) write_op.cc:620] Acquiring the partition lock for write op
0502 14:00:53.281402 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0502 14:00:53.281405 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0502 14:00:53.281463 (+ 58us) tablet.cc:701] Row locks acquired
0502 14:00:53.281465 (+ 2us) write_op.cc:260] PREPARE: finished
0502 14:00:53.281496 (+ 31us) write_op.cc:270] Start()
0502 14:00:53.281523 (+ 27us) write_op.cc:276] Timestamp: P: 1777730453281481 usec, L: 0
0502 14:00:53.281525 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 14:00:53.281744 (+ 219us) log.cc:844] Serialized 432 byte log entry
0502 14:00:53.285284 (+ 3540us) op_driver.cc:464] REPLICATION: finished
0502 14:00:53.285436 (+ 152us) write_op.cc:301] APPLY: starting
0502 14:00:53.285454 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0502 14:00:53.285490 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0502 14:00:53.285587 (+ 97us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 14:00:53.285673 (+ 86us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 14:00:53.285705 (+ 32us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 14:00:53.285710 (+ 5us) write_op.cc:312] APPLY: finished
0502 14:00:53.285782 (+ 72us) log.cc:844] Serialized 28 byte log entry
0502 14:00:53.285844 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:53.285861 (+ 17us) write_op.cc:454] Released schema lock
0502 14:00:53.285867 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0502 14:00:53.285932 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:53.285934 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1116740,"Hive Metastore.run_cpu_time_us":199,"Hive Metastore.run_wall_time_us":42792,"child_traces":[["op",{"apply.queue_time_us":108,"apply.run_cpu_time_us":485,"apply.run_wall_time_us":485,"num_ops":2,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":621,"prepare.run_wall_time_us":622,"raft.queue_time_us":909,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":199,"replication_time_us":3717}]]}
I20260502 14:00:53.287400 7102 catalog_manager.cc:5671] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67). New cstate: current_term: 1 leader_uuid: "c2964848cb1648a4bc2c1d671cc54f62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: HEALTHY } } }
I20260502 14:00:53.291785 7699 consensus_queue.cc:1048] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.307343 7276 tablet_service.cc:1511] Processing CreateTablet for tablet 21a36c9ca269417da55ad6d62428c620 (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.307961 7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a36c9ca269417da55ad6d62428c620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.313567 7555 tablet_service.cc:1511] Processing CreateTablet for tablet 21a36c9ca269417da55ad6d62428c620 (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.313990 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a36c9ca269417da55ad6d62428c620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.315747 7415 tablet_service.cc:1511] Processing CreateTablet for tablet 21a36c9ca269417da55ad6d62428c620 (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.316226 7415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a36c9ca269417da55ad6d62428c620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.316494 7693 tablet_bootstrap.cc:492] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:53.317602 7693 tablet_bootstrap.cc:654] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.318380 7692 tablet_bootstrap.cc:492] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:53.320068 7692 tablet_bootstrap.cc:654] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.319998 7697 consensus_queue.cc:1048] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.320195 7691 tablet_bootstrap.cc:492] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:53.321204 7691 tablet_bootstrap.cc:654] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.325088 7102 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_79e5262b7980424fbe659116c4785e9c" } modify_external_catalogs: true
I20260502 14:00:53.325408 7102 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_79e5262b7980424fbe659116c4785e9c" } modify_external_catalogs: true
I20260502 14:00:53.328984 7693 tablet_bootstrap.cc:492] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:53.329082 7691 tablet_bootstrap.cc:492] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:53.329128 7693 ts_tablet_manager.cc:1403] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.003s
I20260502 14:00:53.329195 7691 ts_tablet_manager.cc:1403] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260502 14:00:53.329913 7693 raft_consensus.cc:359] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.330039 7693 raft_consensus.cc:385] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.330070 7693 raft_consensus.cc:740] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.330021 7691 raft_consensus.cc:359] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.330168 7691 raft_consensus.cc:385] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.330204 7691 raft_consensus.cc:740] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.330376 7691 consensus_queue.cc:260] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.330457 7693 consensus_queue.cc:260] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.331636 7691 ts_tablet_manager.cc:1434] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260502 14:00:53.334034 7693 ts_tablet_manager.cc:1434] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260502 14:00:53.338312 7701 raft_consensus.cc:493] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:53.338426 7701 raft_consensus.cc:515] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.338826 7701 leader_election.cc:290] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:53.339325 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93fca88135c47ddb518e4422d97a601" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:53.339469 7574 raft_consensus.cc:2468] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:53.340296 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93fca88135c47ddb518e4422d97a601" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:53.340432 7297 raft_consensus.cc:2468] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:53.340620 7692 tablet_bootstrap.cc:492] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:53.340727 7692 ts_tablet_manager.cc:1403] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.002s
I20260502 14:00:53.340824 7371 leader_election.cc:304] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:53.341230 7692 raft_consensus.cc:359] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.341338 7692 raft_consensus.cc:385] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.341357 7701 raft_consensus.cc:2804] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:53.341434 7701 raft_consensus.cc:493] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:53.341468 7701 raft_consensus.cc:3060] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.342573 7701 raft_consensus.cc:515] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.342935 7701 leader_election.cc:290] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:53.343928 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93fca88135c47ddb518e4422d97a601" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:53.344053 7297 raft_consensus.cc:3060] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.345103 7297 raft_consensus.cc:2468] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:53.345706 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93fca88135c47ddb518e4422d97a601" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:53.345839 7574 raft_consensus.cc:3060] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.346894 7574 raft_consensus.cc:2468] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:53.347543 7371 leader_election.cc:304] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:53.341365 7692 raft_consensus.cc:740] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.348170 7692 consensus_queue.cc:260] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.348510 7692 ts_tablet_manager.cc:1434] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260502 14:00:53.348775 7708 raft_consensus.cc:2804] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:53.348973 7708 raft_consensus.cc:697] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:00:53.349102 7708 consensus_queue.cc:237] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.369359 7730 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:00:53.370445 7730 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:00:53.370796 7730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:00:53.374961 7767 raft_consensus.cc:493] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:53.375120 7767 raft_consensus.cc:515] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.376593 7767 leader_election.cc:290] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:53.377238 7098 catalog_manager.cc:2174] created HMS catalog entry for table [id=360e84ba87bf4b89826c50fe0b181e15]
I20260502 14:00:53.385439 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282c00536e1e4a708c32917582038281" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:53.385810 7574 raft_consensus.cc:2468] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:00:53.385838 7098 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47700 (request call id 33) took 1311 ms. Trace:
I20260502 14:00:53.385907 7098 rpcz_store.cc:276] 0502 14:00:52.074192 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:52.074255 (+ 63us) service_pool.cc:224] Handling call
0502 14:00:52.120837 (+ 46582us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 14:00:52.121103 (+ 266us) catalog_manager.cc:2147] Created new table and tablet info
0502 14:00:53.377227 (+1256124us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 14:00:53.385249 (+ 8022us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 14:00:53.385349 (+ 100us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 14:00:53.385819 (+ 470us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 14:00:53.379331 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 14:00:53.379458 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0502 14:00:53.379464 (+ 6us) write_op.cc:435] Acquired schema lock
0502 14:00:53.379466 (+ 2us) tablet.cc:662] Decoding operations
0502 14:00:53.379548 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0502 14:00:53.379560 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0502 14:00:53.379563 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0502 14:00:53.379701 (+ 138us) tablet.cc:701] Row locks acquired
0502 14:00:53.379703 (+ 2us) write_op.cc:260] PREPARE: finished
0502 14:00:53.379746 (+ 43us) write_op.cc:270] Start()
0502 14:00:53.379781 (+ 35us) write_op.cc:276] Timestamp: P: 1777730453379723 usec, L: 0
0502 14:00:53.379783 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 14:00:53.379978 (+ 195us) log.cc:844] Serialized 432 byte log entry
0502 14:00:53.384719 (+ 4741us) op_driver.cc:464] REPLICATION: finished
0502 14:00:53.384835 (+ 116us) write_op.cc:301] APPLY: starting
0502 14:00:53.384855 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0502 14:00:53.384889 (+ 34us) tablet.cc:1370] finished BulkCheckPresence
0502 14:00:53.384904 (+ 15us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 14:00:53.385005 (+ 101us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 14:00:53.385033 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 14:00:53.385036 (+ 3us) write_op.cc:312] APPLY: finished
0502 14:00:53.385096 (+ 60us) log.cc:844] Serialized 28 byte log entry
0502 14:00:53.385151 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:53.385168 (+ 17us) write_op.cc:454] Released schema lock
0502 14:00:53.385174 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0502 14:00:53.385251 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:53.385253 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1159161,"Hive Metastore.run_cpu_time_us":206,"Hive Metastore.run_wall_time_us":96680,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":70,"apply.run_cpu_time_us":404,"apply.run_wall_time_us":404,"num_ops":2,"prepare.queue_time_us":1277,"prepare.run_cpu_time_us":756,"prepare.run_wall_time_us":757,"raft.queue_time_us":1361,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":350,"replication_time_us":4904}]]}
I20260502 14:00:53.386298 7233 leader_election.cc:304] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:53.386587 7767 raft_consensus.cc:2804] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:53.386646 7767 raft_consensus.cc:493] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:53.386678 7767 raft_consensus.cc:3060] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.389096 7767 raft_consensus.cc:515] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.389490 7767 leader_election.cc:290] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:53.390002 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282c00536e1e4a708c32917582038281" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:53.390126 7574 raft_consensus.cc:3060] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.391116 7574 raft_consensus.cc:2468] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:00:53.392961 7233 leader_election.cc:304] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:53.393260 7767 raft_consensus.cc:2804] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:53.393353 7767 raft_consensus.cc:697] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:00:53.393671 7767 consensus_queue.cc:237] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.398749 7730 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.126:45121
I20260502 14:00:53.399497 7276 tablet_service.cc:1511] Processing CreateTablet for tablet e41f97896e774ff3bd7853d88ef93be0 (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.399813 7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e41f97896e774ff3bd7853d88ef93be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.400859 7730 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
I20260502 14:00:53.402014 7825 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.126:45121 every 8 connection(s)
I20260502 14:00:53.402446 7098 catalog_manager.cc:5671] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66). New cstate: current_term: 1 leader_uuid: "1be1472a04ae46e48d852d66903d9c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } }
I20260502 14:00:53.402698 7693 tablet_bootstrap.cc:492] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:53.403827 7693 tablet_bootstrap.cc:654] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.408206 7415 tablet_service.cc:1511] Processing CreateTablet for tablet e41f97896e774ff3bd7853d88ef93be0 (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.408288 7435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282c00536e1e4a708c32917582038281" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:53.408402 7435 raft_consensus.cc:3060] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.408525 7415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e41f97896e774ff3bd7853d88ef93be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.408779 7826 sys_catalog.cc:263] Verifying existing consensus state
I20260502 14:00:53.409526 7435 raft_consensus.cc:2468] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:00:53.408218 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282c00536e1e4a708c32917582038281" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:53.409819 7434 raft_consensus.cc:2376] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1. Re-sending same reply.
I20260502 14:00:53.410213 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 7730
I20260502 14:00:53.410656 7555 tablet_service.cc:1511] Processing CreateTablet for tablet e41f97896e774ff3bd7853d88ef93be0 (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.410961 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e41f97896e774ff3bd7853d88ef93be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.412361 7826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap starting.
I20260502 14:00:53.413282 7691 tablet_bootstrap.cc:492] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:53.413434 7692 tablet_bootstrap.cc:492] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:53.414628 7692 tablet_bootstrap.cc:654] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.418186 7691 tablet_bootstrap.cc:654] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.419744 7693 tablet_bootstrap.cc:492] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:53.419857 7693 ts_tablet_manager.cc:1403] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20260502 14:00:53.419983 7692 tablet_bootstrap.cc:492] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:53.420069 7692 ts_tablet_manager.cc:1403] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20260502 14:00:53.420471 7693 raft_consensus.cc:359] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.420476 7692 raft_consensus.cc:359] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.420581 7692 raft_consensus.cc:385] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.420581 7693 raft_consensus.cc:385] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.420612 7692 raft_consensus.cc:740] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.420624 7693 raft_consensus.cc:740] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.420737 7693 consensus_queue.cc:260] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.420737 7692 consensus_queue.cc:260] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.421005 7693 ts_tablet_manager.cc:1434] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:53.421020 7692 ts_tablet_manager.cc:1434] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:53.422874 7098 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_fb7cbf56a40a435aafcbd171a7e85925"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260502 14:00:53.423576 7097 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4534fe13c1d94c399d9c725c85deb6d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260502 14:00:53.424345 7106 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ceee0100290949a6bc0c7926ef8c981e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260502 14:00:53.424714 7691 tablet_bootstrap.cc:492] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:53.424805 7691 ts_tablet_manager.cc:1403] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20260502 14:00:53.425333 7691 raft_consensus.cc:359] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.425470 7691 raft_consensus.cc:385] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.425499 7691 raft_consensus.cc:740] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.425664 7691 consensus_queue.cc:260] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.427752 7691 ts_tablet_manager.cc:1434] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 14:00:53.431128 7826 log.cc:826] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Log is configured to *not* fsync() on all Append() calls
I20260502 14:00:53.440613 7621 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:00:53.440706 7481 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:00:53.445941 7826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:00:53.446398 7826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap complete.
I20260502 14:00:53.451835 7343 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:00:53.453300 7826 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:53.453789 7826 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d590d630acd4892b59504b1c66c4f2d, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.454344 7826 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:53.455862 7826 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: configured and running, proceeding with master startup.
I20260502 14:00:53.459197 7837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:53.459342 7837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:53.464099 7851 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:00:53.464177 7851 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: loading cluster ID for follower catalog manager: success
I20260502 14:00:53.464160 7768 consensus_queue.cc:1048] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.466883 7851 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: acquiring CA information for follower catalog manager: success
I20260502 14:00:53.468235 7780 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" instance_seqno: 1777730451630765) as {username='slave'} at 127.6.125.67:54897; Asking this server to re-register.
I20260502 14:00:53.468605 7851 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 14:00:53.469175 7621 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:53.471103 7768 consensus_queue.cc:1048] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.475646 7780 ts_manager.cc:194] Registered new tserver with Master: c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:53.480269 7708 consensus_queue.cc:1048] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.483351 7780 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" instance_seqno: 1777730451385809) as {username='slave'} at 127.6.125.66:45353; Asking this server to re-register.
I20260502 14:00:53.484895 7781 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" instance_seqno: 1777730451168368) as {username='slave'} at 127.6.125.65:57087; Asking this server to re-register.
I20260502 14:00:53.485558 7343 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:53.487409 7481 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:53.490370 7768 consensus_queue.cc:1048] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.494244 7780 ts_manager.cc:194] Registered new tserver with Master: 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:53.494422 7782 ts_manager.cc:194] Registered new tserver with Master: 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:53.517354 7099 catalog_manager.cc:2174] created HMS catalog entry for table [id=321f6823ca254da0a1df577c65103d77]
I20260502 14:00:53.522838 7099 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47700 (request call id 32) took 1448 ms. Trace:
I20260502 14:00:53.522936 7099 rpcz_store.cc:276] 0502 14:00:52.074110 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:52.074540 (+ 430us) service_pool.cc:224] Handling call
0502 14:00:53.238283 (+1163743us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 14:00:53.238627 (+ 344us) catalog_manager.cc:2147] Created new table and tablet info
0502 14:00:53.517340 (+278713us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 14:00:53.522639 (+ 5299us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 14:00:53.522736 (+ 97us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 14:00:53.522818 (+ 82us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 14:00:53.518017 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 14:00:53.518135 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0502 14:00:53.518139 (+ 4us) write_op.cc:435] Acquired schema lock
0502 14:00:53.518141 (+ 2us) tablet.cc:662] Decoding operations
0502 14:00:53.518226 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0502 14:00:53.518238 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0502 14:00:53.518241 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0502 14:00:53.518300 (+ 59us) tablet.cc:701] Row locks acquired
0502 14:00:53.518302 (+ 2us) write_op.cc:260] PREPARE: finished
0502 14:00:53.518339 (+ 37us) write_op.cc:270] Start()
0502 14:00:53.518380 (+ 41us) write_op.cc:276] Timestamp: P: 1777730453518312 usec, L: 0
0502 14:00:53.518381 (+ 1us) op_driver.cc:348] REPLICATION: starting
0502 14:00:53.518557 (+ 176us) log.cc:844] Serialized 432 byte log entry
0502 14:00:53.521594 (+ 3037us) op_driver.cc:464] REPLICATION: finished
0502 14:00:53.521721 (+ 127us) write_op.cc:301] APPLY: starting
0502 14:00:53.521740 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0502 14:00:53.521775 (+ 35us) tablet.cc:1370] finished BulkCheckPresence
0502 14:00:53.521792 (+ 17us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 14:00:53.521893 (+ 101us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 14:00:53.521922 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 14:00:53.521927 (+ 5us) write_op.cc:312] APPLY: finished
0502 14:00:53.521989 (+ 62us) log.cc:844] Serialized 28 byte log entry
0502 14:00:53.522041 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:53.522056 (+ 15us) write_op.cc:454] Released schema lock
0502 14:00:53.522061 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0502 14:00:53.522119 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:53.522121 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":172160,"Hive Metastore.run_cpu_time_us":246,"Hive Metastore.run_wall_time_us":106399,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":80,"apply.run_cpu_time_us":392,"apply.run_wall_time_us":391,"num_ops":2,"prepare.queue_time_us":66,"prepare.run_cpu_time_us":667,"prepare.run_wall_time_us":668,"raft.queue_time_us":117,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":253,"replication_time_us":3168}]]}
W20260502 14:00:53.530464 7104 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5bbf52ba925f45dfae2bee0f411a0316 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260502 14:00:53.531459 7276 tablet_service.cc:1511] Processing CreateTablet for tablet c93263c445ad4872a7e33c9e22709300 (DEFAULT_TABLE table=default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.531781 7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93263c445ad4872a7e33c9e22709300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.532028 7099 catalog_manager.cc:5671] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65). New cstate: current_term: 1 leader_uuid: "4dacd17b49934d2c99a91c60aa672f02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: UNKNOWN } } }
I20260502 14:00:53.533720 7555 tablet_service.cc:1511] Processing CreateTablet for tablet c93263c445ad4872a7e33c9e22709300 (DEFAULT_TABLE table=default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.534034 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93263c445ad4872a7e33c9e22709300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.534907 7415 tablet_service.cc:1511] Processing CreateTablet for tablet c93263c445ad4872a7e33c9e22709300 (DEFAULT_TABLE table=default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.535198 7415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93263c445ad4872a7e33c9e22709300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.536018 7693 tablet_bootstrap.cc:492] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:53.536880 7691 tablet_bootstrap.cc:492] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:53.537200 7693 tablet_bootstrap.cc:654] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.538290 7691 tablet_bootstrap.cc:654] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.540640 7692 tablet_bootstrap.cc:492] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:53.541175 7703 raft_consensus.cc:493] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:53.541280 7703 raft_consensus.cc:515] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.541712 7703 leader_election.cc:290] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:53.541796 7692 tablet_bootstrap.cc:654] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.542268 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a36c9ca269417da55ad6d62428c620" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:53.542402 7434 raft_consensus.cc:2468] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:00:53.542636 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a36c9ca269417da55ad6d62428c620" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:53.542712 7233 leader_election.cc:304] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:53.542771 7572 raft_consensus.cc:2468] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:00:53.542898 7703 raft_consensus.cc:2804] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:53.542944 7703 raft_consensus.cc:493] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:53.542979 7703 raft_consensus.cc:3060] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.544108 7703 raft_consensus.cc:515] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.544499 7703 leader_election.cc:290] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:53.545141 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a36c9ca269417da55ad6d62428c620" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:53.545269 7572 raft_consensus.cc:3060] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.546815 7572 raft_consensus.cc:2468] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:00:53.548329 7233 leader_election.cc:304] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:53.548519 7691 tablet_bootstrap.cc:492] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:53.548529 7703 raft_consensus.cc:2804] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:53.548600 7703 raft_consensus.cc:697] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:00:53.548628 7691 ts_tablet_manager.cc:1403] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260502 14:00:53.548769 7693 tablet_bootstrap.cc:492] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:53.548727 7703 consensus_queue.cc:237] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.548906 7693 ts_tablet_manager.cc:1403] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260502 14:00:53.549259 7691 raft_consensus.cc:359] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.549397 7691 raft_consensus.cc:385] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.549432 7691 raft_consensus.cc:740] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.549350 7693 raft_consensus.cc:359] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.549573 7693 raft_consensus.cc:385] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.549631 7693 raft_consensus.cc:740] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.549754 7693 consensus_queue.cc:260] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.549571 7691 consensus_queue.cc:260] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.550060 7693 ts_tablet_manager.cc:1434] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:53.551169 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a36c9ca269417da55ad6d62428c620" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:53.551303 7434 raft_consensus.cc:3060] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.552373 7434 raft_consensus.cc:2468] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:00:53.554718 7691 ts_tablet_manager.cc:1434] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260502 14:00:53.559193 7099 catalog_manager.cc:5671] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65). New cstate: current_term: 1 leader_uuid: "4dacd17b49934d2c99a91c60aa672f02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: UNKNOWN } } }
I20260502 14:00:53.568202 7099 master_service.cc:954] ReplaceTablet: received request to replace tablet 22429e0ec4464a6c8499cb47aa4558fd from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:53.572474 7692 tablet_bootstrap.cc:492] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:53.572623 7692 ts_tablet_manager.cc:1403] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20260502 14:00:53.573120 7692 raft_consensus.cc:359] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.573266 7692 raft_consensus.cc:385] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.573307 7692 raft_consensus.cc:740] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.573437 7692 consensus_queue.cc:260] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.573762 7692 ts_tablet_manager.cc:1434] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:53.575456 7767 raft_consensus.cc:493] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:53.575565 7767 raft_consensus.cc:515] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.575991 7767 leader_election.cc:290] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:53.577705 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41f97896e774ff3bd7853d88ef93be0" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:53.577852 7572 raft_consensus.cc:2468] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:00:53.578147 7233 leader_election.cc:304] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:53.578218 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41f97896e774ff3bd7853d88ef93be0" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:53.578330 7434 raft_consensus.cc:2468] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:00:53.578397 7767 raft_consensus.cc:2804] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:53.578442 7767 raft_consensus.cc:493] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:53.578477 7767 raft_consensus.cc:3060] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.579649 7767 raft_consensus.cc:515] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.579919 7099 catalog_manager.cc:5958] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Sending DeleteTablet for 3 replicas of tablet 22429e0ec4464a6c8499cb47aa4558fd
I20260502 14:00:53.580199 7767 leader_election.cc:290] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:53.580538 7276 tablet_service.cc:1558] Processing DeleteTablet for tablet 22429e0ec4464a6c8499cb47aa4558fd with delete_type TABLET_DATA_DELETED (replaced by tablet 20b64fa709284798944325339eb67a0f) from {username='slave'} at 127.0.0.1:44408
I20260502 14:00:53.580879 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41f97896e774ff3bd7853d88ef93be0" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:53.580999 7434 raft_consensus.cc:3060] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.581241 7415 tablet_service.cc:1558] Processing DeleteTablet for tablet 22429e0ec4464a6c8499cb47aa4558fd with delete_type TABLET_DATA_DELETED (replaced by tablet 20b64fa709284798944325339eb67a0f) from {username='slave'} at 127.0.0.1:43518
I20260502 14:00:53.581862 7555 tablet_service.cc:1558] Processing DeleteTablet for tablet 22429e0ec4464a6c8499cb47aa4558fd with delete_type TABLET_DATA_DELETED (replaced by tablet 20b64fa709284798944325339eb67a0f) from {username='slave'} at 127.0.0.1:58268
I20260502 14:00:53.582034 7434 raft_consensus.cc:2468] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:00:53.582486 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41f97896e774ff3bd7853d88ef93be0" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:53.582625 7572 raft_consensus.cc:3060] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.583323 7099 catalog_manager.cc:6741] ReplaceTablet: tablet 22429e0ec4464a6c8499cb47aa4558fd deleted and replaced by tablet 20b64fa709284798944325339eb67a0f
I20260502 14:00:53.583657 7572 raft_consensus.cc:2468] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:00:53.584067 7867 tablet_replica.cc:333] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:00:53.584196 7867 raft_consensus.cc:2243] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:53.584444 7867 raft_consensus.cc:2272] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:53.584720 7866 tablet_replica.cc:333] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:53.584847 7866 raft_consensus.cc:2243] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:53.584976 7866 raft_consensus.cc:2272] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:53.585229 7865 tablet_replica.cc:333] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:53.585379 7865 raft_consensus.cc:2243] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:53.585511 7865 raft_consensus.cc:2272] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:53.586007 7233 leader_election.cc:304] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:53.586829 7866 ts_tablet_manager.cc:1916] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:53.588303 7865 ts_tablet_manager.cc:1916] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:53.591102 7866 ts_tablet_manager.cc:1929] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:53.591184 7866 log.cc:1199] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/22429e0ec4464a6c8499cb47aa4558fd
I20260502 14:00:53.591426 7866 ts_tablet_manager.cc:1950] T 22429e0ec4464a6c8499cb47aa4558fd P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:53.591749 7867 ts_tablet_manager.cc:1916] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:53.592725 7276 tablet_service.cc:1511] Processing CreateTablet for tablet 20b64fa709284798944325339eb67a0f (DEFAULT_TABLE table=default.table_22762929a67d4e56be830cb18eaa2af8 [id=d99c8ace41cc4593aadfe92cd5fa1c16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.593015 7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b64fa709284798944325339eb67a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.593919 7867 ts_tablet_manager.cc:1929] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:53.593987 7867 log.cc:1199] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/22429e0ec4464a6c8499cb47aa4558fd
I20260502 14:00:53.594226 7867 ts_tablet_manager.cc:1950] T 22429e0ec4464a6c8499cb47aa4558fd P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:00:53.595856 7693 tablet_bootstrap.cc:492] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:53.597023 7693 tablet_bootstrap.cc:654] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.597230 7865 ts_tablet_manager.cc:1929] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:53.597290 7865 log.cc:1199] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/22429e0ec4464a6c8499cb47aa4558fd
I20260502 14:00:53.597540 7865 ts_tablet_manager.cc:1950] T 22429e0ec4464a6c8499cb47aa4558fd P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:53.598094 7768 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:53.598199 7768 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.598374 7093 catalog_manager.cc:5002] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): tablet 22429e0ec4464a6c8499cb47aa4558fd (table default.table_22762929a67d4e56be830cb18eaa2af8 [id=d99c8ace41cc4593aadfe92cd5fa1c16]) successfully deleted
I20260502 14:00:53.598795 7768 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:53.599174 7767 raft_consensus.cc:2804] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:53.599264 7767 raft_consensus.cc:697] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:00:53.599357 7555 tablet_service.cc:1511] Processing CreateTablet for tablet 20b64fa709284798944325339eb67a0f (DEFAULT_TABLE table=default.table_22762929a67d4e56be830cb18eaa2af8 [id=d99c8ace41cc4593aadfe92cd5fa1c16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.599392 7767 consensus_queue.cc:237] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:53.599628 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b64fa709284798944325339eb67a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.602437 7691 tablet_bootstrap.cc:492] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:53.603152 7099 catalog_manager.cc:5671] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65). New cstate: current_term: 1 leader_uuid: "4dacd17b49934d2c99a91c60aa672f02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: HEALTHY } } }
I20260502 14:00:53.603570 7691 tablet_bootstrap.cc:654] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.604811 7415 tablet_service.cc:1511] Processing CreateTablet for tablet 20b64fa709284798944325339eb67a0f (DEFAULT_TABLE table=default.table_22762929a67d4e56be830cb18eaa2af8 [id=d99c8ace41cc4593aadfe92cd5fa1c16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:53.605113 7415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b64fa709284798944325339eb67a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:53.607344 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93263c445ad4872a7e33c9e22709300" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:53.607729 7296 raft_consensus.cc:2468] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:53.608269 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93263c445ad4872a7e33c9e22709300" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:53.608294 7368 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:53.608407 7572 raft_consensus.cc:2468] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:53.608492 7768 raft_consensus.cc:2804] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:53.608542 7768 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:53.608665 7768 raft_consensus.cc:3060] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.609669 7768 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.610287 7768 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:53.611020 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93263c445ad4872a7e33c9e22709300" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:53.611269 7296 raft_consensus.cc:3060] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.613121 7296 raft_consensus.cc:2468] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:53.613860 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93263c445ad4872a7e33c9e22709300" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:53.614073 7572 raft_consensus.cc:3060] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.615051 7572 raft_consensus.cc:2468] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:53.615445 7371 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:53.615885 7768 raft_consensus.cc:2804] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:53.616015 7768 raft_consensus.cc:697] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:00:53.616195 7768 consensus_queue.cc:237] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.616480 7692 tablet_bootstrap.cc:492] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:53.617727 7692 tablet_bootstrap.cc:654] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:53.623337 7093 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet 22429e0ec4464a6c8499cb47aa4558fd (table default.table_22762929a67d4e56be830cb18eaa2af8 [id=d99c8ace41cc4593aadfe92cd5fa1c16]) successfully deleted
I20260502 14:00:53.624264 7090 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet 22429e0ec4464a6c8499cb47aa4558fd (table default.table_22762929a67d4e56be830cb18eaa2af8 [id=d99c8ace41cc4593aadfe92cd5fa1c16]) successfully deleted
I20260502 14:00:53.624890 7693 tablet_bootstrap.cc:492] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:53.625010 7693 ts_tablet_manager.cc:1403] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260502 14:00:53.625101 7691 tablet_bootstrap.cc:492] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:53.625185 7691 ts_tablet_manager.cc:1403] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20260502 14:00:53.625535 7693 raft_consensus.cc:359] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.625654 7693 raft_consensus.cc:385] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.625685 7693 raft_consensus.cc:740] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.625645 7691 raft_consensus.cc:359] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.625738 7691 raft_consensus.cc:385] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.625766 7691 raft_consensus.cc:740] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.625883 7691 consensus_queue.cc:260] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.626152 7691 ts_tablet_manager.cc:1434] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:00:53.626716 7692 tablet_bootstrap.cc:492] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:53.626803 7692 ts_tablet_manager.cc:1403] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20260502 14:00:53.627288 7692 raft_consensus.cc:359] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.627394 7692 raft_consensus.cc:385] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:53.627426 7692 raft_consensus.cc:740] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:53.627543 7692 consensus_queue.cc:260] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.627828 7692 ts_tablet_manager.cc:1434] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:00:53.631109 7693 consensus_queue.cc:260] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.633510 7099 catalog_manager.cc:5671] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66). New cstate: current_term: 1 leader_uuid: "1be1472a04ae46e48d852d66903d9c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: UNKNOWN } } }
I20260502 14:00:53.639814 7693 ts_tablet_manager.cc:1434] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260502 14:00:53.644356 7099 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_2f350d07bc2340ceaf7259efed2efac2" } modify_external_catalogs: true
I20260502 14:00:53.644644 7099 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_2f350d07bc2340ceaf7259efed2efac2" } modify_external_catalogs: true
I20260502 14:00:53.652828 7837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5d257c30a994bfdb03242b10606426f. Latest consensus state: current_term: 3 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:53.653110 7837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:53.653244 7837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:53.653329 7837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:53.663700 7831 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:53.663909 7831 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: LEADER
I20260502 14:00:53.694954 7874 mvcc.cc:204] Tried to move back new op lower bound from 7281583937963085824 to 7281583931550351360. Current Snapshot: MvccSnapshot[applied={T|T < 7281583937886969856}]
I20260502 14:00:53.712834 7703 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:53.712991 7703 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.713441 7703 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:53.714464 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b64fa709284798944325339eb67a0f" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:53.714639 7434 raft_consensus.cc:2468] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:00:53.714890 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b64fa709284798944325339eb67a0f" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:53.715010 7572 raft_consensus.cc:2468] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:00:53.715595 7233 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:53.716004 7703 raft_consensus.cc:2804] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:53.716063 7703 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:53.716097 7703 raft_consensus.cc:3060] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.717334 7703 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.717800 7703 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:53.725050 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b64fa709284798944325339eb67a0f" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:53.725214 7434 raft_consensus.cc:3060] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.726397 7434 raft_consensus.cc:2468] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:00:53.727519 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b64fa709284798944325339eb67a0f" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:53.727669 7572 raft_consensus.cc:3060] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:53.728718 7572 raft_consensus.cc:2468] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:00:53.729246 7233 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:53.730002 7703 raft_consensus.cc:2804] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:53.730108 7703 raft_consensus.cc:697] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:00:53.730254 7703 consensus_queue.cc:237] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:53.781733 7697 consensus_queue.cc:1048] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.805915 7699 consensus_queue.cc:1048] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.891170 7768 consensus_queue.cc:1048] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.896476 7701 consensus_queue.cc:1048] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.919550 7703 consensus_queue.cc:1048] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.929968 7767 consensus_queue.cc:1048] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.967661 7767 consensus_queue.cc:1048] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:53.984896 7703 consensus_queue.cc:1048] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:54.002171 7768 consensus_queue.cc:1048] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:54.013520 7701 consensus_queue.cc:1048] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:54.035305 7890 consensus_queue.cc:1048] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:54.037951 7103 catalog_manager.cc:3502] renamed table default.table_6c9325cba2ed431fa72add0d6f4fb869 [id=5f7ce7415f6e4ee19261effe9db10f86] in HMS: new name default.table_0d20cbe3e06443a39d25177f4abb4de7
I20260502 14:00:54.042676 7703 consensus_queue.cc:1048] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:54.113368 7105 catalog_manager.cc:3502] renamed table default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e] in HMS: new name default.table_f0b8f5be35da4f878de056348eefee40
I20260502 14:00:54.140007 7896 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:00:54.140180 7896 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:54.140873 7896 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:00:54.141310 7116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 4 candidate_status { last_received { term: 3 index: 43 } } ignore_live_leader: false dest_uuid: "a5d257c30a994bfdb03242b10606426f" is_pre_election: true
I20260502 14:00:54.146214 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 4 candidate_status { last_received { term: 3 index: 43 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d" is_pre_election: true
I20260502 14:00:54.147141 7020 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80; no voters: 9d590d630acd4892b59504b1c66c4f2d, a5d257c30a994bfdb03242b10606426f
I20260502 14:00:54.147485 7896 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260502 14:00:54.166755 7898 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:00:54.167212 7898 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:54.171700 7898 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:00:54.172127 7045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d590d630acd4892b59504b1c66c4f2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 43 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80" is_pre_election: true
I20260502 14:00:54.172313 7045 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d590d630acd4892b59504b1c66c4f2d in term 3.
I20260502 14:00:54.172643 7116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d590d630acd4892b59504b1c66c4f2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 43 } } ignore_live_leader: false dest_uuid: "a5d257c30a994bfdb03242b10606426f" is_pre_election: true
I20260502 14:00:54.172789 7773 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters:
I20260502 14:00:54.173045 7898 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260502 14:00:54.173141 7898 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:00:54.173202 7898 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 3 FOLLOWER]: Advancing to term 4
I20260502 14:00:54.175726 7898 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:54.176498 7898 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 4 election: Requested vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:00:54.176754 7045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d590d630acd4892b59504b1c66c4f2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 43 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80"
I20260502 14:00:54.176891 7045 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 3 FOLLOWER]: Advancing to term 4
I20260502 14:00:54.177958 7045 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d590d630acd4892b59504b1c66c4f2d in term 4.
I20260502 14:00:54.178455 7116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d590d630acd4892b59504b1c66c4f2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 43 } } ignore_live_leader: false dest_uuid: "a5d257c30a994bfdb03242b10606426f"
I20260502 14:00:54.178526 7773 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters:
I20260502 14:00:54.178922 7898 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 4 FOLLOWER]: Leader election won for term 4
I20260502 14:00:54.179168 7898 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 4 LEADER]: Becoming Leader. State: Replica: 9d590d630acd4892b59504b1c66c4f2d, State: Running, Role: LEADER
I20260502 14:00:54.179549 7898 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 3.43, Last appended by leader: 43, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:54.181289 7898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d590d630acd4892b59504b1c66c4f2d. Latest consensus state: current_term: 4 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:54.181651 7898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: LEADER
I20260502 14:00:54.182067 7900 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 14:00:54.189383 7900 catalog_manager.cc:679] Loaded metadata for table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]
I20260502 14:00:54.190238 7900 catalog_manager.cc:679] Loaded metadata for table default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e]
I20260502 14:00:54.191256 7900 catalog_manager.cc:679] Loaded metadata for table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]
I20260502 14:00:54.192032 7900 catalog_manager.cc:679] Loaded metadata for table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]
I20260502 14:00:54.192337 7900 catalog_manager.cc:679] Loaded metadata for table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]
I20260502 14:00:54.192560 7900 catalog_manager.cc:679] Loaded metadata for table default.table_6c9325cba2ed431fa72add0d6f4fb869 [id=5f7ce7415f6e4ee19261effe9db10f86]
I20260502 14:00:54.193071 7900 catalog_manager.cc:679] Loaded metadata for table default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]
I20260502 14:00:54.193310 7900 catalog_manager.cc:679] Loaded metadata for table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]
I20260502 14:00:54.193499 7900 catalog_manager.cc:679] Loaded metadata for table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]
I20260502 14:00:54.193856 7900 catalog_manager.cc:679] Loaded metadata for table default.table_22762929a67d4e56be830cb18eaa2af8 [id=d99c8ace41cc4593aadfe92cd5fa1c16]
I20260502 14:00:54.195233 7900 tablet_loader.cc:96] loaded metadata for tablet 20b64fa709284798944325339eb67a0f (table default.table_22762929a67d4e56be830cb18eaa2af8 [id=d99c8ace41cc4593aadfe92cd5fa1c16])
I20260502 14:00:54.195541 7900 tablet_loader.cc:96] loaded metadata for tablet 21a36c9ca269417da55ad6d62428c620 (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a])
I20260502 14:00:54.196648 7900 tablet_loader.cc:96] loaded metadata for tablet 282c00536e1e4a708c32917582038281 (table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f])
I20260502 14:00:54.197031 7900 tablet_loader.cc:96] loaded metadata for tablet 429294b843b744caa11ea0b4ab3c6067 (table default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504])
I20260502 14:00:54.197220 7900 tablet_loader.cc:96] loaded metadata for tablet 8310c91704af422ebdd03855376a5d44 (table default.table_6c9325cba2ed431fa72add0d6f4fb869 [id=5f7ce7415f6e4ee19261effe9db10f86])
I20260502 14:00:54.197844 7900 tablet_loader.cc:96] loaded metadata for tablet 87287e19be8043d79878f64ba123b3eb (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3])
I20260502 14:00:54.198282 7900 tablet_loader.cc:96] loaded metadata for tablet b93fca88135c47ddb518e4422d97a601 (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065])
I20260502 14:00:54.198702 7900 tablet_loader.cc:96] loaded metadata for tablet c93263c445ad4872a7e33c9e22709300 (table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77])
I20260502 14:00:54.199225 7900 tablet_loader.cc:96] loaded metadata for tablet e14a927cc21141f389ff5fe174b0225a (table default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e])
I20260502 14:00:54.199409 7900 tablet_loader.cc:96] loaded metadata for tablet e41f97896e774ff3bd7853d88ef93be0 (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15])
I20260502 14:00:54.199635 7900 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 14:00:54.201006 7900 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:00:54.201081 7900 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 14:00:54.201984 7900 catalog_manager.cc:1514] Loading token signing keys...
I20260502 14:00:54.202567 7900 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Loaded TSK: 0
I20260502 14:00:54.203929 7900 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 14:00:54.204661 7900 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 14:00:54.205193 7900 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 10
I20260502 14:00:54.207847 7890 consensus_queue.cc:1048] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:54.211786 7781 catalog_manager.cc:5671] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65). New cstate: current_term: 1 leader_uuid: "4dacd17b49934d2c99a91c60aa672f02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } }
I20260502 14:00:54.223529 7767 consensus_queue.cc:1048] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:54.227437 7045 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 4 FOLLOWER]: Refusing update from remote peer 9d590d630acd4892b59504b1c66c4f2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 43. Preceding OpId from leader: term: 4 index: 45. (index mismatch)
I20260502 14:00:54.227429 7116 raft_consensus.cc:3055] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 3 LEADER]: Stepping down as leader of term 3
I20260502 14:00:54.227535 7116 raft_consensus.cc:740] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a5d257c30a994bfdb03242b10606426f, State: Running, Role: LEADER
I20260502 14:00:54.227702 7116 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 3.43, Last appended by leader: 43, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:54.227972 7116 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 3 FOLLOWER]: Advancing to term 4
I20260502 14:00:54.228000 7899 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260502 14:00:54.229522 7896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d590d630acd4892b59504b1c66c4f2d. Latest consensus state: current_term: 4 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:54.229737 7896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:54.230358 7100 catalog_manager.cc:3502] renamed table default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504] in HMS: new name default.table_9c2adeda8ca24651b8be47c058c64d23
I20260502 14:00:54.230392 7116 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 4 FOLLOWER]: Refusing update from remote peer 9d590d630acd4892b59504b1c66c4f2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 43. Preceding OpId from leader: term: 4 index: 45. (index mismatch)
I20260502 14:00:54.231540 7899 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260502 14:00:54.232697 7899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:54.232815 7899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: LEADER
I20260502 14:00:54.235916 7896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:54.236058 7896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:54.236780 7621 heartbeater.cc:499] Master 127.6.125.126:45121 was elected leader, sending a full tablet report...
I20260502 14:00:54.239563 7898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:54.239694 7898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: LEADER
I20260502 14:00:54.241062 7909 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:54.241293 7909 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:54.242091 7907 mvcc.cc:204] Tried to move back new op lower bound from 7281583940508893184 to 7281583940323524608. Current Snapshot: MvccSnapshot[applied={T|T < 7281583940508893184}]
I20260502 14:00:54.241288 7906 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d590d630acd4892b59504b1c66c4f2d. Latest consensus state: current_term: 4 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:54.242230 7906 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:54.303270 7101 catalog_manager.cc:3502] renamed table default.table_22762929a67d4e56be830cb18eaa2af8 [id=d99c8ace41cc4593aadfe92cd5fa1c16] in HMS: new name default.table_da5e1cd539c94420b562a58316eecee9
I20260502 14:00:54.325587 7481 heartbeater.cc:499] Master 127.6.125.126:45121 was elected leader, sending a full tablet report...
I20260502 14:00:54.344681 7097 catalog_manager.cc:2174] created HMS catalog entry for table [id=c582269726e0451697a103262b5d83bf]
W20260502 14:00:54.345490 7097 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica a5d257c30a994bfdb03242b10606426f is not leader of this config: current role FOLLOWER
I20260502 14:00:54.380879 7106 catalog_manager.cc:2174] created HMS catalog entry for table [id=8a2c0c92a3134a67977521b717f89a5a]
W20260502 14:00:54.381580 7106 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica a5d257c30a994bfdb03242b10606426f is not leader of this config: current role FOLLOWER
W20260502 14:00:54.387871 7163 catalog_manager.cc:3939] Illegal state: an error occurred while updating the sys-catalog: replica a5d257c30a994bfdb03242b10606426f is not leader of this config: current role FOLLOWER
W20260502 14:00:54.388159 7163 hms_notification_log_listener.cc:329] Failed to handle Hive Metastore notification: 11 ALTER_TABLE default.table_0d20cbe3e06443a39d25177f4abb4de7: Illegal state: an error occurred while updating the sys-catalog: replica a5d257c30a994bfdb03242b10606426f is not leader of this config: current role FOLLOWER
W20260502 14:00:54.388259 7163 hms_notification_log_listener.cc:143] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events: an error occurred while updating the sys-catalog: replica a5d257c30a994bfdb03242b10606426f is not leader of this config: current role FOLLOWER
I20260502 14:00:54.388618 7098 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47700 (request call id 48) took 1399 ms. Trace:
I20260502 14:00:54.388697 7098 rpcz_store.cc:276] 0502 14:00:52.989439 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:53.422776 (+433337us) service_pool.cc:224] Handling call
0502 14:00:54.388596 (+965820us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 14:00:54.390344 7098 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47700 (request call id 51) took 1271 ms. Trace:
I20260502 14:00:54.390405 7098 rpcz_store.cc:276] 0502 14:00:53.118756 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:54.390173 (+1271417us) service_pool.cc:224] Handling call
0502 14:00:54.390330 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 14:00:54.390523 7098 master_service.cc:954] ReplaceTablet: received request to replace tablet e14a927cc21141f389ff5fe174b0225a from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:54.390708 7098 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47700 (request call id 52) took 1270 ms. Trace:
I20260502 14:00:54.390753 7098 rpcz_store.cc:276] 0502 14:00:53.120331 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:54.390505 (+1270174us) service_pool.cc:224] Handling call
0502 14:00:54.390697 (+ 192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 14:00:54.390983 7098 master_service.cc:954] ReplaceTablet: received request to replace tablet 87287e19be8043d79878f64ba123b3eb from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:54.391161 7098 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47700 (request call id 53) took 1252 ms. Trace:
I20260502 14:00:54.391207 7098 rpcz_store.cc:276] 0502 14:00:53.139114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:54.390962 (+1251848us) service_pool.cc:224] Handling call
0502 14:00:54.391149 (+ 187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 14:00:54.391320 7098 master_service.cc:954] ReplaceTablet: received request to replace tablet 429294b843b744caa11ea0b4ab3c6067 from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:54.391489 7098 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47700 (request call id 54) took 1245 ms. Trace:
I20260502 14:00:54.391532 7098 rpcz_store.cc:276] 0502 14:00:53.145931 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:54.391300 (+1245369us) service_pool.cc:224] Handling call
0502 14:00:54.391476 (+ 176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 14:00:54.391633 7098 master_service.cc:954] ReplaceTablet: received request to replace tablet 8310c91704af422ebdd03855376a5d44 from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:54.391788 7098 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47700 (request call id 55) took 1244 ms. Trace:
W20260502 14:00:54.394819 7630 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.6.125.124:43159)
W20260502 14:00:54.395147 7630 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.6.125.124:43159)
I20260502 14:00:54.391880 7098 rpcz_store.cc:276] 0502 14:00:53.147205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:54.391618 (+1244413us) service_pool.cc:224] Handling call
0502 14:00:54.391778 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 14:00:54.392697 7103 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:47700 (request call id 35) took 1784 ms. Trace:
I20260502 14:00:54.393085 7105 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:47700 (request call id 36) took 1760 ms. Trace:
I20260502 14:00:54.400285 7103 rpcz_store.cc:276] 0502 14:00:52.608293 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:52.609957 (+ 1664us) service_pool.cc:224] Handling call
0502 14:00:53.422648 (+812691us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 14:00:54.392185 (+969537us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 14:00:54.392444 (+ 259us) catalog_manager.cc:3725] Apply alter schema
0502 14:00:54.392681 (+ 237us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":98862,"Hive Metastore.run_cpu_time_us":867,"Hive Metastore.run_wall_time_us":515928}
I20260502 14:00:54.400372 7105 rpcz_store.cc:276] 0502 14:00:52.632831 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:52.632890 (+ 59us) service_pool.cc:224] Handling call
0502 14:00:53.422991 (+790101us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 14:00:54.392741 (+969750us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 14:00:54.392903 (+ 162us) catalog_manager.cc:3725] Apply alter schema
0502 14:00:54.393071 (+ 168us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":614542,"Hive Metastore.run_cpu_time_us":607,"Hive Metastore.run_wall_time_us":75638,"spinlock_wait_cycles":1203072}
I20260502 14:00:54.401181 7105 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:47700 (request call id 56) took 1216 ms. Trace:
I20260502 14:00:54.401232 7105 rpcz_store.cc:276] 0502 14:00:53.184727 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:54.401037 (+1216310us) service_pool.cc:224] Handling call
0502 14:00:54.401170 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 14:00:54.401482 7105 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47700 (request call id 57) took 1128 ms. Trace:
I20260502 14:00:54.393440 7100 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:47700 (request call id 37) took 1705 ms. Trace:
I20260502 14:00:54.401552 7103 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:47700 (request call id 58) took 1111 ms. Trace:
I20260502 14:00:54.393746 7101 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:47700 (request call id 43) took 1600 ms. Trace:
I20260502 14:00:54.401615 7101 rpcz_store.cc:276] 0502 14:00:52.793769 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:52.944378 (+150609us) service_pool.cc:224] Handling call
0502 14:00:53.423257 (+478879us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 14:00:54.393474 (+970217us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 14:00:54.393616 (+ 142us) catalog_manager.cc:3725] Apply alter schema
0502 14:00:54.393735 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":807033,"Hive Metastore.run_cpu_time_us":609,"Hive Metastore.run_wall_time_us":72832}
I20260502 14:00:54.401932 7101 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47700 (request call id 59) took 1018 ms. Trace:
I20260502 14:00:54.401976 7101 rpcz_store.cc:276] 0502 14:00:53.383467 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:54.401777 (+1018310us) service_pool.cc:224] Handling call
0502 14:00:54.401922 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 14:00:54.402179 7101 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:47700 (request call id 60) took 1013 ms. Trace:
I20260502 14:00:54.402216 7101 rpcz_store.cc:276] 0502 14:00:53.388827 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:54.402050 (+1013223us) service_pool.cc:224] Handling call
0502 14:00:54.402170 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 14:00:54.402865 7101 master_service.cc:954] ReplaceTablet: received request to replace tablet b93fca88135c47ddb518e4422d97a601 from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:54.401582 7100 rpcz_store.cc:276] 0502 14:00:52.688027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:52.702561 (+ 14534us) service_pool.cc:224] Handling call
0502 14:00:53.423138 (+720577us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 14:00:54.393125 (+969987us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 14:00:54.393261 (+ 136us) catalog_manager.cc:3725] Apply alter schema
0502 14:00:54.393426 (+ 165us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":690108,"Hive Metastore.run_cpu_time_us":584,"Hive Metastore.run_wall_time_us":116994}
I20260502 14:00:54.404640 7730 master_runner.cc:232] Existing masters have differing terms: 3 vs 4
I20260502 14:00:54.404760 7730 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:00:54.405817 7630 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.6.125.124:43159)
W20260502 14:00:54.406071 7630 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.6.125.124:43159)
I20260502 14:00:54.401541 7105 rpcz_store.cc:276] 0502 14:00:53.273336 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:54.401338 (+1128002us) service_pool.cc:224] Handling call
0502 14:00:54.401472 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 14:00:54.401599 7103 rpcz_store.cc:276] 0502 14:00:53.289781 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:54.401455 (+1111674us) service_pool.cc:224] Handling call
0502 14:00:54.401544 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260502 14:00:54.419885 7781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47324:
name: "default.Table_916010ddd67a42689b76591a02784a0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:54.420502 7783 master_service.cc:954] ReplaceTablet: received request to replace tablet 87287e19be8043d79878f64ba123b3eb from {username='slave'} at 127.0.0.1:47324
I20260502 14:00:54.420554 7782 master_service.cc:954] ReplaceTablet: received request to replace tablet e14a927cc21141f389ff5fe174b0225a from {username='slave'} at 127.0.0.1:47324
I20260502 14:00:54.420770 7784 master_service.cc:954] ReplaceTablet: received request to replace tablet 429294b843b744caa11ea0b4ab3c6067 from {username='slave'} at 127.0.0.1:47324
I20260502 14:00:54.420957 7785 master_service.cc:954] ReplaceTablet: received request to replace tablet 8310c91704af422ebdd03855376a5d44 from {username='slave'} at 127.0.0.1:47324
I20260502 14:00:54.421629 7786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47324:
table { table_name: "default.Table_2866c4520a3d40c4b3c6ca93424e5a0b" } modify_external_catalogs: true
I20260502 14:00:54.421790 7786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47324:
table { table_name: "default.Table_2866c4520a3d40c4b3c6ca93424e5a0b" } modify_external_catalogs: true
I20260502 14:00:54.422163 7788 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47324:
table { table_name: "default.Table_d303c0450b934f2bb0f8ab01b92f2e67" } new_table_name: "default.Table_18b522eec8284015942366c63506ec7e" modify_external_catalogs: true
I20260502 14:00:54.422418 7789 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47324:
name: "default.Table_7091f4920e384b37862f746b07e5372f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:54.423207 7343 heartbeater.cc:499] Master 127.6.125.126:45121 was elected leader, sending a full tablet report...
I20260502 14:00:54.424541 7787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47324:
name: "default.Table_116f97550c144f10bc14cc8c29c1d169"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:54.430079 7780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47324:
name: "default.Table_fb7cbf56a40a435aafcbd171a7e85925"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:54.438388 7782 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Sending DeleteTablet for 3 replicas of tablet e14a927cc21141f389ff5fe174b0225a
I20260502 14:00:54.439638 7782 catalog_manager.cc:6741] ReplaceTablet: tablet e14a927cc21141f389ff5fe174b0225a deleted and replaced by tablet 8fa858fb3eb243808f40536c334420be
I20260502 14:00:54.449644 7784 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Sending DeleteTablet for 3 replicas of tablet 429294b843b744caa11ea0b4ab3c6067
I20260502 14:00:54.449999 7784 catalog_manager.cc:6741] ReplaceTablet: tablet 429294b843b744caa11ea0b4ab3c6067 deleted and replaced by tablet ca22b8c0f0384693bb0399b1b3319b87
I20260502 14:00:54.451134 7783 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Sending DeleteTablet for 3 replicas of tablet 87287e19be8043d79878f64ba123b3eb
I20260502 14:00:54.451421 7783 catalog_manager.cc:6741] ReplaceTablet: tablet 87287e19be8043d79878f64ba123b3eb deleted and replaced by tablet 769798507a234e7392d713d05f6d41d7
I20260502 14:00:54.451591 7783 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47324:
table { table_name: "default.Table_0912854d0fb44cf69bf731fbb257be24" } modify_external_catalogs: true
I20260502 14:00:54.451715 7783 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47324:
table { table_name: "default.Table_0912854d0fb44cf69bf731fbb257be24" } modify_external_catalogs: true
I20260502 14:00:54.451980 7785 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Sending DeleteTablet for 3 replicas of tablet 8310c91704af422ebdd03855376a5d44
I20260502 14:00:54.452220 7785 catalog_manager.cc:6741] ReplaceTablet: tablet 8310c91704af422ebdd03855376a5d44 deleted and replaced by tablet 0250841509464228af907fcb4f28dcae
I20260502 14:00:54.452411 7785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47324:
name: "default.Table_afe9c083ff0b4d1487651533fee05e6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:54.454670 7782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47324:
name: "default.Table_c3fa81d759a04db897e93aa688729318"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:54.475859 7104 catalog_manager.cc:2174] created HMS catalog entry for table [id=2e0834670d044a0fbe32ffcd671a778b]
W20260502 14:00:54.476361 7850 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0250841509464228af907fcb4f28dcae consensus state has no leader
W20260502 14:00:54.476395 7104 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica a5d257c30a994bfdb03242b10606426f is not leader of this config: current role FOLLOWER
I20260502 14:00:54.476569 7784 master_service.cc:954] ReplaceTablet: received request to replace tablet b93fca88135c47ddb518e4422d97a601 from {username='slave'} at 127.0.0.1:47324
I20260502 14:00:54.481176 7554 tablet_service.cc:1558] Processing DeleteTablet for tablet 87287e19be8043d79878f64ba123b3eb with delete_type TABLET_DATA_DELETED (replaced by tablet 769798507a234e7392d713d05f6d41d7) from {username='slave'} at 127.0.0.1:58276
I20260502 14:00:54.481412 7551 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa858fb3eb243808f40536c334420be (DEFAULT_TABLE table=default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.481446 7555 tablet_service.cc:1558] Processing DeleteTablet for tablet e14a927cc21141f389ff5fe174b0225a with delete_type TABLET_DATA_DELETED (replaced by tablet 8fa858fb3eb243808f40536c334420be) from {username='slave'} at 127.0.0.1:58276
I20260502 14:00:54.481585 7549 tablet_service.cc:1511] Processing CreateTablet for tablet 769798507a234e7392d713d05f6d41d7 (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.481705 7551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa858fb3eb243808f40536c334420be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.481952 7548 tablet_service.cc:1511] Processing CreateTablet for tablet 0250841509464228af907fcb4f28dcae (DEFAULT_TABLE table=default.table_6c9325cba2ed431fa72add0d6f4fb869 [id=5f7ce7415f6e4ee19261effe9db10f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.482154 7548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0250841509464228af907fcb4f28dcae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.482578 7415 tablet_service.cc:1558] Processing DeleteTablet for tablet e14a927cc21141f389ff5fe174b0225a with delete_type TABLET_DATA_DELETED (replaced by tablet 8fa858fb3eb243808f40536c334420be) from {username='slave'} at 127.0.0.1:43520
I20260502 14:00:54.482832 7414 tablet_service.cc:1558] Processing DeleteTablet for tablet 429294b843b744caa11ea0b4ab3c6067 with delete_type TABLET_DATA_DELETED (replaced by tablet ca22b8c0f0384693bb0399b1b3319b87) from {username='slave'} at 127.0.0.1:43520
I20260502 14:00:54.483032 7413 tablet_service.cc:1558] Processing DeleteTablet for tablet 87287e19be8043d79878f64ba123b3eb with delete_type TABLET_DATA_DELETED (replaced by tablet 769798507a234e7392d713d05f6d41d7) from {username='slave'} at 127.0.0.1:43520
I20260502 14:00:54.483160 7412 tablet_service.cc:1558] Processing DeleteTablet for tablet 8310c91704af422ebdd03855376a5d44 with delete_type TABLET_DATA_DELETED (replaced by tablet 0250841509464228af907fcb4f28dcae) from {username='slave'} at 127.0.0.1:43520
I20260502 14:00:54.483443 7411 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa858fb3eb243808f40536c334420be (DEFAULT_TABLE table=default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.483671 7411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa858fb3eb243808f40536c334420be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.481586 7552 tablet_service.cc:1558] Processing DeleteTablet for tablet 429294b843b744caa11ea0b4ab3c6067 with delete_type TABLET_DATA_DELETED (replaced by tablet ca22b8c0f0384693bb0399b1b3319b87) from {username='slave'} at 127.0.0.1:58276
I20260502 14:00:54.481190 7553 tablet_service.cc:1558] Processing DeleteTablet for tablet 8310c91704af422ebdd03855376a5d44 with delete_type TABLET_DATA_DELETED (replaced by tablet 0250841509464228af907fcb4f28dcae) from {username='slave'} at 127.0.0.1:58276
I20260502 14:00:54.484088 7549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769798507a234e7392d713d05f6d41d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.484126 7550 tablet_service.cc:1511] Processing CreateTablet for tablet ca22b8c0f0384693bb0399b1b3319b87 (DEFAULT_TABLE table=default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.484334 7550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca22b8c0f0384693bb0399b1b3319b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.486049 7410 tablet_service.cc:1511] Processing CreateTablet for tablet ca22b8c0f0384693bb0399b1b3319b87 (DEFAULT_TABLE table=default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.486269 7410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca22b8c0f0384693bb0399b1b3319b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.484019 7928 tablet_bootstrap.cc:492] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:54.487885 7928 tablet_bootstrap.cc:654] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.488309 7409 tablet_service.cc:1511] Processing CreateTablet for tablet 769798507a234e7392d713d05f6d41d7 (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.488567 7409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769798507a234e7392d713d05f6d41d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.489053 7929 tablet_bootstrap.cc:492] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:54.490023 7929 tablet_bootstrap.cc:654] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.490586 7408 tablet_service.cc:1511] Processing CreateTablet for tablet 0250841509464228af907fcb4f28dcae (DEFAULT_TABLE table=default.table_6c9325cba2ed431fa72add0d6f4fb869 [id=5f7ce7415f6e4ee19261effe9db10f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.490836 7408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0250841509464228af907fcb4f28dcae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.489094 7927 tablet_replica.cc:333] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:54.496892 7276 tablet_service.cc:1558] Processing DeleteTablet for tablet e14a927cc21141f389ff5fe174b0225a with delete_type TABLET_DATA_DELETED (replaced by tablet 8fa858fb3eb243808f40536c334420be) from {username='slave'} at 127.0.0.1:44416
I20260502 14:00:54.497184 7277 tablet_service.cc:1558] Processing DeleteTablet for tablet 429294b843b744caa11ea0b4ab3c6067 with delete_type TABLET_DATA_DELETED (replaced by tablet ca22b8c0f0384693bb0399b1b3319b87) from {username='slave'} at 127.0.0.1:44416
I20260502 14:00:54.497184 7274 tablet_service.cc:1558] Processing DeleteTablet for tablet 8310c91704af422ebdd03855376a5d44 with delete_type TABLET_DATA_DELETED (replaced by tablet 0250841509464228af907fcb4f28dcae) from {username='slave'} at 127.0.0.1:44416
I20260502 14:00:54.497421 7273 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa858fb3eb243808f40536c334420be (DEFAULT_TABLE table=default.table_5e304d38082c4c6baeee1789cc1d2de2 [id=2e16fc53645e4ac09e94393928628f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.497704 7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa858fb3eb243808f40536c334420be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.498843 7275 tablet_service.cc:1558] Processing DeleteTablet for tablet 87287e19be8043d79878f64ba123b3eb with delete_type TABLET_DATA_DELETED (replaced by tablet 769798507a234e7392d713d05f6d41d7) from {username='slave'} at 127.0.0.1:44416
I20260502 14:00:54.499176 7927 raft_consensus.cc:2243] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:54.499856 7272 tablet_service.cc:1511] Processing CreateTablet for tablet ca22b8c0f0384693bb0399b1b3319b87 (DEFAULT_TABLE table=default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.500095 7926 tablet_replica.cc:333] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:00:54.500150 7272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca22b8c0f0384693bb0399b1b3319b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.500190 7927 raft_consensus.cc:2272] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.500301 7926 raft_consensus.cc:2243] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:54.500553 7926 raft_consensus.cc:2272] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.500679 7927 ts_tablet_manager.cc:1916] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.501163 7926 ts_tablet_manager.cc:1916] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.501379 7932 tablet_replica.cc:333] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:54.502813 7927 ts_tablet_manager.cc:1929] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.502939 7927 log.cc:1199] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/e14a927cc21141f389ff5fe174b0225a
W20260502 14:00:54.503096 7850 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8fa858fb3eb243808f40536c334420be consensus state has no leader
I20260502 14:00:54.503188 7784 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Sending DeleteTablet for 3 replicas of tablet b93fca88135c47ddb518e4422d97a601
I20260502 14:00:54.503474 7784 catalog_manager.cc:6741] ReplaceTablet: tablet b93fca88135c47ddb518e4422d97a601 deleted and replaced by tablet a8b8e0ebe82440bf893a8712608d569b
I20260502 14:00:54.503496 7927 ts_tablet_manager.cc:1950] T e14a927cc21141f389ff5fe174b0225a P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:54.503590 7926 ts_tablet_manager.cc:1929] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.501856 7271 tablet_service.cc:1511] Processing CreateTablet for tablet 769798507a234e7392d713d05f6d41d7 (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.502044 7269 tablet_service.cc:1511] Processing CreateTablet for tablet 0250841509464228af907fcb4f28dcae (DEFAULT_TABLE table=default.table_6c9325cba2ed431fa72add0d6f4fb869 [id=5f7ce7415f6e4ee19261effe9db10f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.504133 7271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769798507a234e7392d713d05f6d41d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.504405 7927 tablet_replica.cc:333] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:54.504518 7927 raft_consensus.cc:2243] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:54.504696 7927 raft_consensus.cc:2272] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.504637 7784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47324:
name: "default.Table_3803b7a44d4847adabbc5a04821f0382"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:54.505105 7927 ts_tablet_manager.cc:1916] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.505236 7272 tablet_service.cc:1558] Processing DeleteTablet for tablet b93fca88135c47ddb518e4422d97a601 with delete_type TABLET_DATA_DELETED (replaced by tablet a8b8e0ebe82440bf893a8712608d569b) from {username='slave'} at 127.0.0.1:44416
I20260502 14:00:54.506587 7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0250841509464228af907fcb4f28dcae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.506924 7927 ts_tablet_manager.cc:1929] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.506980 7927 log.cc:1199] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/429294b843b744caa11ea0b4ab3c6067
I20260502 14:00:54.507200 7927 ts_tablet_manager.cc:1950] T 429294b843b744caa11ea0b4ab3c6067 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:54.507354 7773 catalog_manager.cc:5002] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): tablet e14a927cc21141f389ff5fe174b0225a (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]) successfully deleted
I20260502 14:00:54.507463 7408 tablet_service.cc:1558] Processing DeleteTablet for tablet b93fca88135c47ddb518e4422d97a601 with delete_type TABLET_DATA_DELETED (replaced by tablet a8b8e0ebe82440bf893a8712608d569b) from {username='slave'} at 127.0.0.1:43520
I20260502 14:00:54.507709 7933 tablet_bootstrap.cc:492] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
W20260502 14:00:54.508416 7771 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 0250841509464228af907fcb4f28dcae (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0250841509464228af907fcb4f28dcae consensus state has no leader
I20260502 14:00:54.508898 7933 tablet_bootstrap.cc:654] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.508925 7932 raft_consensus.cc:2243] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:54.509725 7932 raft_consensus.cc:2272] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.509795 7927 tablet_replica.cc:333] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:54.509918 7927 raft_consensus.cc:2243] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:54.510030 7927 raft_consensus.cc:2272] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.510267 7932 ts_tablet_manager.cc:1916] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.510968 7773 catalog_manager.cc:5002] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): tablet 429294b843b744caa11ea0b4ab3c6067 (table default.table_a373f862bd114b1090e1aeba01375597 [id=a4faee50852b47da98cc7526f3f29504]) successfully deleted
I20260502 14:00:54.515980 7408 tablet_service.cc:1511] Processing CreateTablet for tablet a8b8e0ebe82440bf893a8712608d569b (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.516314 7408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b8e0ebe82440bf893a8712608d569b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.516353 7269 tablet_service.cc:1511] Processing CreateTablet for tablet a8b8e0ebe82440bf893a8712608d569b (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.516628 7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b8e0ebe82440bf893a8712608d569b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.517441 7932 ts_tablet_manager.cc:1929] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.517503 7932 log.cc:1199] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/e14a927cc21141f389ff5fe174b0225a
I20260502 14:00:54.517745 7932 ts_tablet_manager.cc:1950] T e14a927cc21141f389ff5fe174b0225a P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:54.508009 7548 tablet_service.cc:1558] Processing DeleteTablet for tablet b93fca88135c47ddb518e4422d97a601 with delete_type TABLET_DATA_DELETED (replaced by tablet a8b8e0ebe82440bf893a8712608d569b) from {username='slave'} at 127.0.0.1:58276
I20260502 14:00:54.516034 7550 tablet_service.cc:1511] Processing CreateTablet for tablet a8b8e0ebe82440bf893a8712608d569b (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.518143 7550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b8e0ebe82440bf893a8712608d569b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260502 14:00:54.519155 7850 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca22b8c0f0384693bb0399b1b3319b87 consensus state has no leader
I20260502 14:00:54.521142 7926 log.cc:1199] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/87287e19be8043d79878f64ba123b3eb
I20260502 14:00:54.521240 7927 ts_tablet_manager.cc:1916] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.521550 7926 ts_tablet_manager.cc:1950] T 87287e19be8043d79878f64ba123b3eb P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:00:54.522387 7926 tablet_replica.cc:333] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:00:54.522564 7926 raft_consensus.cc:2243] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:54.522679 7773 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet 87287e19be8043d79878f64ba123b3eb (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]) successfully deleted
I20260502 14:00:54.522894 7926 raft_consensus.cc:2272] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.523533 7927 ts_tablet_manager.cc:1929] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.523535 7770 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet e14a927cc21141f389ff5fe174b0225a (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]) successfully deleted
I20260502 14:00:54.523644 7927 log.cc:1199] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/87287e19be8043d79878f64ba123b3eb
I20260502 14:00:54.523934 7927 ts_tablet_manager.cc:1950] T 87287e19be8043d79878f64ba123b3eb P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:54.524164 7926 ts_tablet_manager.cc:1916] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.524361 7932 tablet_replica.cc:333] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:54.524523 7932 raft_consensus.cc:2243] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:54.526644 7926 ts_tablet_manager.cc:1929] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.526854 7932 raft_consensus.cc:2272] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.527294 7932 ts_tablet_manager.cc:1916] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.529309 7932 ts_tablet_manager.cc:1929] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.529307 7928 tablet_bootstrap.cc:492] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:54.530084 7928 ts_tablet_manager.cc:1403] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.000s
I20260502 14:00:54.530602 7928 raft_consensus.cc:359] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:54.530707 7928 raft_consensus.cc:385] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.530737 7928 raft_consensus.cc:740] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.530865 7928 consensus_queue.cc:260] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:54.531136 7928 ts_tablet_manager.cc:1434] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:54.531363 7928 tablet_bootstrap.cc:492] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:54.532435 7928 tablet_bootstrap.cc:654] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.536178 7926 log.cc:1199] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/e14a927cc21141f389ff5fe174b0225a
I20260502 14:00:54.536563 7926 ts_tablet_manager.cc:1950] T e14a927cc21141f389ff5fe174b0225a P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:00:54.537009 7929 tablet_bootstrap.cc:492] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:54.537114 7929 ts_tablet_manager.cc:1403] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.000s
I20260502 14:00:54.537612 7929 raft_consensus.cc:359] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:54.537715 7929 raft_consensus.cc:385] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.537748 7929 raft_consensus.cc:740] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.537886 7929 consensus_queue.cc:260] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:54.538164 7929 ts_tablet_manager.cc:1434] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:54.538362 7929 tablet_bootstrap.cc:492] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:54.539626 7929 tablet_bootstrap.cc:654] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.541548 7926 tablet_replica.cc:333] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:00:54.541679 7926 raft_consensus.cc:2243] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:54.541786 7926 raft_consensus.cc:2272] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.542165 7926 ts_tablet_manager.cc:1916] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.542220 7773 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet e14a927cc21141f389ff5fe174b0225a (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]) successfully deleted
I20260502 14:00:54.544334 7926 ts_tablet_manager.cc:1929] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.544518 7932 log.cc:1199] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/429294b843b744caa11ea0b4ab3c6067
I20260502 14:00:54.544867 7932 ts_tablet_manager.cc:1950] T 429294b843b744caa11ea0b4ab3c6067 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:54.546109 7770 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet 429294b843b744caa11ea0b4ab3c6067 (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]) successfully deleted
I20260502 14:00:54.546468 7932 tablet_replica.cc:333] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:54.546605 7929 tablet_bootstrap.cc:492] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:54.546723 7929 ts_tablet_manager.cc:1403] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260502 14:00:54.546650 7932 raft_consensus.cc:2243] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:54.546933 7932 raft_consensus.cc:2272] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.547421 7932 ts_tablet_manager.cc:1916] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.547272 7929 raft_consensus.cc:359] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.547646 7929 raft_consensus.cc:385] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.547717 7929 raft_consensus.cc:740] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.547879 7929 consensus_queue.cc:260] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
W20260502 14:00:54.548034 7781 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_916010ddd67a42689b76591a02784a0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260502 14:00:54.548230 7929 ts_tablet_manager.cc:1434] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260502 14:00:54.548454 7929 tablet_bootstrap.cc:492] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:54.549449 7929 tablet_bootstrap.cc:654] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.550676 7929 tablet_bootstrap.cc:492] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:54.550766 7929 ts_tablet_manager.cc:1403] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260502 14:00:54.551242 7929 raft_consensus.cc:359] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.551355 7929 raft_consensus.cc:385] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.551391 7929 raft_consensus.cc:740] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.551497 7929 consensus_queue.cc:260] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.551761 7929 ts_tablet_manager.cc:1434] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 14:00:54.551962 7929 tablet_bootstrap.cc:492] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:54.554425 7929 tablet_bootstrap.cc:654] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.545552 7928 tablet_bootstrap.cc:492] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:54.555380 7928 ts_tablet_manager.cc:1403] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260502 14:00:54.556106 7928 raft_consensus.cc:359] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.556222 7928 raft_consensus.cc:385] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.556249 7928 raft_consensus.cc:740] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.556366 7928 consensus_queue.cc:260] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.556641 7928 ts_tablet_manager.cc:1434] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:54.556842 7928 tablet_bootstrap.cc:492] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:54.557101 7929 tablet_bootstrap.cc:492] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:54.557186 7929 ts_tablet_manager.cc:1403] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260502 14:00:54.557665 7929 raft_consensus.cc:359] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.557770 7929 raft_consensus.cc:385] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.557801 7929 raft_consensus.cc:740] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.557914 7928 tablet_bootstrap.cc:654] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.557917 7929 consensus_queue.cc:260] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.558175 7929 ts_tablet_manager.cc:1434] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:54.558346 7929 tablet_bootstrap.cc:492] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:54.559587 7929 tablet_bootstrap.cc:654] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.561848 7926 log.cc:1199] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/429294b843b744caa11ea0b4ab3c6067
I20260502 14:00:54.562276 7926 ts_tablet_manager.cc:1950] T 429294b843b744caa11ea0b4ab3c6067 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:00:54.562633 7929 tablet_bootstrap.cc:492] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:54.562743 7929 ts_tablet_manager.cc:1403] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 14:00:54.563244 7929 raft_consensus.cc:359] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.563369 7929 raft_consensus.cc:385] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.563402 7929 raft_consensus.cc:740] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.563521 7929 consensus_queue.cc:260] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.563815 7929 ts_tablet_manager.cc:1434] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:54.564203 7932 ts_tablet_manager.cc:1929] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.564287 7932 log.cc:1199] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/8310c91704af422ebdd03855376a5d44
I20260502 14:00:54.564514 7932 ts_tablet_manager.cc:1950] T 8310c91704af422ebdd03855376a5d44 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:54.565066 7773 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet 429294b843b744caa11ea0b4ab3c6067 (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]) successfully deleted
I20260502 14:00:54.567569 7926 tablet_replica.cc:333] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:00:54.568759 7770 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet 8310c91704af422ebdd03855376a5d44 (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]) successfully deleted
I20260502 14:00:54.569082 7926 raft_consensus.cc:2243] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:54.569252 7926 raft_consensus.cc:2272] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.569689 7926 ts_tablet_manager.cc:1916] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.569938 7932 tablet_replica.cc:333] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:54.570073 7932 raft_consensus.cc:2243] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:54.570176 7932 raft_consensus.cc:2272] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260502 14:00:54.570282 7789 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7091f4920e384b37862f746b07e5372f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260502 14:00:54.571065 7773 catalog_manager.cc:5002] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): tablet 87287e19be8043d79878f64ba123b3eb (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]) successfully deleted
I20260502 14:00:54.571856 7927 tablet_replica.cc:333] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:54.572033 7927 raft_consensus.cc:2243] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:54.572296 7927 raft_consensus.cc:2272] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.572769 7927 ts_tablet_manager.cc:1916] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.574235 7926 ts_tablet_manager.cc:1929] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.574326 7926 log.cc:1199] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/8310c91704af422ebdd03855376a5d44
I20260502 14:00:54.574779 7936 tablet.cc:1724] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 14:00:54.575083 7932 ts_tablet_manager.cc:1916] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.575381 7927 ts_tablet_manager.cc:1929] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.575461 7927 log.cc:1199] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/8310c91704af422ebdd03855376a5d44
I20260502 14:00:54.575520 7937 tablet.cc:1724] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 14:00:54.575700 7927 ts_tablet_manager.cc:1950] T 8310c91704af422ebdd03855376a5d44 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:54.576591 7927 tablet_replica.cc:333] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:54.576722 7927 raft_consensus.cc:2243] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:54.576776 7773 catalog_manager.cc:5002] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): tablet 8310c91704af422ebdd03855376a5d44 (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]) successfully deleted
I20260502 14:00:54.576943 7927 raft_consensus.cc:2272] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.577510 7927 ts_tablet_manager.cc:1916] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.583590 7927 ts_tablet_manager.cc:1929] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.583694 7927 log.cc:1199] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/b93fca88135c47ddb518e4422d97a601
I20260502 14:00:54.583933 7933 tablet_bootstrap.cc:492] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:54.583993 7927 ts_tablet_manager.cc:1950] T b93fca88135c47ddb518e4422d97a601 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:54.584049 7933 ts_tablet_manager.cc:1403] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.076s user 0.001s sys 0.001s
I20260502 14:00:54.584489 7933 raft_consensus.cc:359] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:54.584682 7933 raft_consensus.cc:385] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.584728 7933 raft_consensus.cc:740] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.584860 7933 consensus_queue.cc:260] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:54.585157 7933 ts_tablet_manager.cc:1434] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:54.585403 7933 tablet_bootstrap.cc:492] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:54.586540 7933 tablet_bootstrap.cc:654] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.590505 7773 catalog_manager.cc:5002] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): tablet b93fca88135c47ddb518e4422d97a601 (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]) successfully deleted
I20260502 14:00:54.592725 7933 tablet_bootstrap.cc:492] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:54.592872 7933 ts_tablet_manager.cc:1403] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260502 14:00:54.593425 7933 raft_consensus.cc:359] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.593545 7933 raft_consensus.cc:385] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.593576 7933 raft_consensus.cc:740] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.593712 7933 consensus_queue.cc:260] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.593993 7933 ts_tablet_manager.cc:1434] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:54.594215 7933 tablet_bootstrap.cc:492] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:54.594534 7932 ts_tablet_manager.cc:1929] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.594600 7932 log.cc:1199] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/87287e19be8043d79878f64ba123b3eb
I20260502 14:00:54.594822 7932 ts_tablet_manager.cc:1950] T 87287e19be8043d79878f64ba123b3eb P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:54.595440 7933 tablet_bootstrap.cc:654] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.600597 7932 tablet_replica.cc:333] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:54.600726 7770 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet 87287e19be8043d79878f64ba123b3eb (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]) successfully deleted
I20260502 14:00:54.600756 7932 raft_consensus.cc:2243] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:54.600881 7932 raft_consensus.cc:2272] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.575202 7928 tablet_bootstrap.cc:492] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:54.577335 7938 tablet.cc:1724] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 14:00:54.601109 7928 ts_tablet_manager.cc:1403] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.000s
I20260502 14:00:54.601631 7928 raft_consensus.cc:359] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.601754 7928 raft_consensus.cc:385] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.601842 7928 raft_consensus.cc:740] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.601974 7928 consensus_queue.cc:260] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.602246 7928 ts_tablet_manager.cc:1434] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:00:54.602442 7928 tablet_bootstrap.cc:492] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:54.602644 7932 ts_tablet_manager.cc:1916] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.603536 7928 tablet_bootstrap.cc:654] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.604864 7926 ts_tablet_manager.cc:1950] T 8310c91704af422ebdd03855376a5d44 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:00:54.605497 7926 tablet_replica.cc:333] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:00:54.605813 7926 raft_consensus.cc:2243] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:54.605945 7926 raft_consensus.cc:2272] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:54.605967 7773 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet 8310c91704af422ebdd03855376a5d44 (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]) successfully deleted
I20260502 14:00:54.608152 7926 ts_tablet_manager.cc:1916] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:54.609496 7932 ts_tablet_manager.cc:1929] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.610172 7933 tablet_bootstrap.cc:492] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:54.610344 7933 ts_tablet_manager.cc:1403] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260502 14:00:54.610527 7926 ts_tablet_manager.cc:1929] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:54.610594 7926 log.cc:1199] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/b93fca88135c47ddb518e4422d97a601
I20260502 14:00:54.610829 7926 ts_tablet_manager.cc:1950] T b93fca88135c47ddb518e4422d97a601 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:00:54.610965 7933 raft_consensus.cc:359] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.611096 7933 raft_consensus.cc:385] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.611127 7933 raft_consensus.cc:740] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.611284 7933 consensus_queue.cc:260] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.611589 7933 ts_tablet_manager.cc:1434] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:54.611819 7933 tablet_bootstrap.cc:492] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:54.612914 7933 tablet_bootstrap.cc:654] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.614805 7932 log.cc:1199] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/b93fca88135c47ddb518e4422d97a601
I20260502 14:00:54.615159 7932 ts_tablet_manager.cc:1950] T b93fca88135c47ddb518e4422d97a601 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:54.616230 7770 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet b93fca88135c47ddb518e4422d97a601 (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]) successfully deleted
I20260502 14:00:54.616544 7773 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet b93fca88135c47ddb518e4422d97a601 (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]) successfully deleted
I20260502 14:00:54.621037 7928 tablet_bootstrap.cc:492] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:54.621172 7928 ts_tablet_manager.cc:1403] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20260502 14:00:54.621717 7928 raft_consensus.cc:359] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.621856 7928 raft_consensus.cc:385] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.621896 7928 raft_consensus.cc:740] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.622027 7928 consensus_queue.cc:260] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.622294 7928 ts_tablet_manager.cc:1434] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260502 14:00:54.622511 7928 tablet_bootstrap.cc:492] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:54.623796 7928 tablet_bootstrap.cc:654] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.626832 7701 raft_consensus.cc:493] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:54.626945 7701 raft_consensus.cc:515] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.627290 7928 tablet_bootstrap.cc:492] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:54.627333 7701 leader_election.cc:290] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:54.627379 7928 ts_tablet_manager.cc:1403] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260502 14:00:54.627645 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca22b8c0f0384693bb0399b1b3319b87" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:54.627734 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca22b8c0f0384693bb0399b1b3319b87" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:54.627933 7572 raft_consensus.cc:2468] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:54.628001 7296 raft_consensus.cc:2468] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:54.628274 7371 leader_election.cc:304] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:54.628509 7708 raft_consensus.cc:2804] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:54.628624 7708 raft_consensus.cc:493] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:54.628674 7708 raft_consensus.cc:3060] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.629616 7708 raft_consensus.cc:515] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.629980 7708 leader_election.cc:290] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:54.630424 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca22b8c0f0384693bb0399b1b3319b87" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:54.630555 7296 raft_consensus.cc:3060] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.631510 7296 raft_consensus.cc:2468] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:54.631865 7368 leader_election.cc:304] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:54.632058 7768 raft_consensus.cc:2804] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:54.632126 7768 raft_consensus.cc:697] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:00:54.632251 7768 consensus_queue.cc:237] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.635088 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca22b8c0f0384693bb0399b1b3319b87" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:54.635227 7574 raft_consensus.cc:3060] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.636296 7574 raft_consensus.cc:2468] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:54.637323 7928 raft_consensus.cc:359] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.637537 7928 raft_consensus.cc:385] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.637637 7928 raft_consensus.cc:740] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.637862 7928 consensus_queue.cc:260] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.641736 7928 ts_tablet_manager.cc:1434] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260502 14:00:54.646780 7933 tablet_bootstrap.cc:492] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:54.646912 7933 ts_tablet_manager.cc:1403] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
I20260502 14:00:54.647451 7933 raft_consensus.cc:359] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.647585 7933 raft_consensus.cc:385] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.647624 7933 raft_consensus.cc:740] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.647759 7933 consensus_queue.cc:260] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.648082 7933 ts_tablet_manager.cc:1434] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260502 14:00:54.648303 7933 tablet_bootstrap.cc:492] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:54.648852 7697 raft_consensus.cc:493] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:54.648952 7697 raft_consensus.cc:515] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.649355 7697 leader_election.cc:290] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:54.649391 7933 tablet_bootstrap.cc:654] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.649900 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769798507a234e7392d713d05f6d41d7" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:54.650028 7296 raft_consensus.cc:2468] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:54.650147 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769798507a234e7392d713d05f6d41d7" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:54.650278 7434 raft_consensus.cc:2468] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:54.650545 7508 leader_election.cc:304] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:54.651121 7697 raft_consensus.cc:2804] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:54.651176 7697 raft_consensus.cc:493] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:54.651211 7697 raft_consensus.cc:3060] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.652204 7697 raft_consensus.cc:515] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.652560 7697 leader_election.cc:290] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:54.653082 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769798507a234e7392d713d05f6d41d7" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:54.653162 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769798507a234e7392d713d05f6d41d7" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:54.653204 7434 raft_consensus.cc:3060] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.653254 7296 raft_consensus.cc:3060] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.654090 7434 raft_consensus.cc:2468] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:54.654093 7296 raft_consensus.cc:2468] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:54.654412 7511 leader_election.cc:304] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:54.654659 7697 raft_consensus.cc:2804] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:54.654850 7697 raft_consensus.cc:697] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:00:54.655004 7697 consensus_queue.cc:237] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.657842 7933 tablet_bootstrap.cc:492] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:54.657965 7933 ts_tablet_manager.cc:1403] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260502 14:00:54.658597 7933 raft_consensus.cc:359] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.658716 7933 raft_consensus.cc:385] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.658748 7933 raft_consensus.cc:740] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.658880 7933 consensus_queue.cc:260] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.659142 7933 ts_tablet_manager.cc:1434] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:54.683794 7781 catalog_manager.cc:2174] created HMS catalog entry for table [id=337d1a2589374574b8d3b1735b5efe95]
I20260502 14:00:54.693262 7781 catalog_manager.cc:5763] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597) does not have the latest schema for tablet 20b64fa709284798944325339eb67a0f (table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]). Expected version 1 got 0
I20260502 14:00:54.695452 7781 catalog_manager.cc:5763] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739) does not have the latest schema for tablet 8fa858fb3eb243808f40536c334420be (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]). Expected version 1 got 0
I20260502 14:00:54.704735 7269 tablet_service.cc:1511] Processing CreateTablet for tablet 912c143ef13f42529ec28b08615db7dd (DEFAULT_TABLE table=default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.705129 7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 912c143ef13f42529ec28b08615db7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.707706 7933 tablet_bootstrap.cc:492] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:54.708966 7933 tablet_bootstrap.cc:654] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.710928 7781 catalog_manager.cc:5763] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873) does not have the latest schema for tablet 8fa858fb3eb243808f40536c334420be (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]). Expected version 1 got 0
I20260502 14:00:54.711306 7550 tablet_service.cc:1511] Processing CreateTablet for tablet 912c143ef13f42529ec28b08615db7dd (DEFAULT_TABLE table=default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.711634 7550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 912c143ef13f42529ec28b08615db7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.712647 7781 catalog_manager.cc:5763] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597) does not have the latest schema for tablet 8fa858fb3eb243808f40536c334420be (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]). Expected version 1 got 0
I20260502 14:00:54.712775 7781 catalog_manager.cc:5763] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597) does not have the latest schema for tablet ca22b8c0f0384693bb0399b1b3319b87 (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]). Expected version 1 got 0
I20260502 14:00:54.712872 7781 catalog_manager.cc:5763] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597) does not have the latest schema for tablet 0250841509464228af907fcb4f28dcae (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]). Expected version 1 got 0
I20260502 14:00:54.714140 7928 tablet_bootstrap.cc:492] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:54.714412 7408 tablet_service.cc:1511] Processing CreateTablet for tablet 912c143ef13f42529ec28b08615db7dd (DEFAULT_TABLE table=default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:54.714704 7408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 912c143ef13f42529ec28b08615db7dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:54.715075 7928 tablet_bootstrap.cc:654] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.721278 7781 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16] alter complete (version 1)
I20260502 14:00:54.723213 7929 tablet_bootstrap.cc:492] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:54.723310 7781 catalog_manager.cc:5763] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739) does not have the latest schema for tablet ca22b8c0f0384693bb0399b1b3319b87 (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]). Expected version 1 got 0
I20260502 14:00:54.723459 7781 catalog_manager.cc:5671] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67). New cstate: current_term: 1 leader_uuid: "c2964848cb1648a4bc2c1d671cc54f62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } }
I20260502 14:00:54.723753 7781 catalog_manager.cc:5763] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739) does not have the latest schema for tablet 0250841509464228af907fcb4f28dcae (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]). Expected version 1 got 0
I20260502 14:00:54.724412 7929 tablet_bootstrap.cc:654] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:54.725541 7708 raft_consensus.cc:493] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:54.725662 7708 raft_consensus.cc:515] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:54.726145 7708 leader_election.cc:290] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:54.728832 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa858fb3eb243808f40536c334420be" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:54.728999 7296 raft_consensus.cc:2468] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:54.729524 7368 leader_election.cc:304] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:54.730136 7933 tablet_bootstrap.cc:492] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:54.730170 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa858fb3eb243808f40536c334420be" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:54.730234 7933 ts_tablet_manager.cc:1403] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20260502 14:00:54.730319 7574 raft_consensus.cc:2468] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:54.731031 7933 raft_consensus.cc:359] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:54.731153 7933 raft_consensus.cc:385] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.731187 7933 raft_consensus.cc:740] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.731194 7708 raft_consensus.cc:2804] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:54.731251 7708 raft_consensus.cc:493] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:54.731287 7708 raft_consensus.cc:3060] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.731336 7933 consensus_queue.cc:260] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:54.732007 7933 ts_tablet_manager.cc:1434] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260502 14:00:54.732707 7708 raft_consensus.cc:515] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:54.733644 7708 leader_election.cc:290] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:54.734385 7929 tablet_bootstrap.cc:492] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:54.734475 7929 ts_tablet_manager.cc:1403] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260502 14:00:54.734405 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa858fb3eb243808f40536c334420be" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:54.734746 7296 raft_consensus.cc:3060] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.735217 7929 raft_consensus.cc:359] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:54.735327 7929 raft_consensus.cc:385] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.735358 7929 raft_consensus.cc:740] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.735489 7929 consensus_queue.cc:260] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:54.736002 7296 raft_consensus.cc:2468] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:54.736150 7929 ts_tablet_manager.cc:1434] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260502 14:00:54.736742 7928 tablet_bootstrap.cc:492] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:54.736840 7928 ts_tablet_manager.cc:1403] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20260502 14:00:54.737347 7928 raft_consensus.cc:359] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:54.737460 7928 raft_consensus.cc:385] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:54.737501 7928 raft_consensus.cc:740] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:54.737654 7928 consensus_queue.cc:260] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:54.737965 7928 ts_tablet_manager.cc:1434] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:54.739785 7368 leader_election.cc:304] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:54.740121 7708 raft_consensus.cc:2804] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:54.740224 7708 raft_consensus.cc:697] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:00:54.740358 7708 consensus_queue.cc:237] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:54.740782 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa858fb3eb243808f40536c334420be" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:54.740907 7574 raft_consensus.cc:3060] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.741953 7574 raft_consensus.cc:2468] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:54.742645 7768 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:54.742729 7768 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.743081 7768 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:54.745196 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0250841509464228af907fcb4f28dcae" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:54.745360 7574 raft_consensus.cc:2468] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:54.745766 7371 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:54.745937 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0250841509464228af907fcb4f28dcae" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:54.746239 7296 raft_consensus.cc:2468] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:54.746640 7768 raft_consensus.cc:2804] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:54.746702 7768 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:54.746740 7768 raft_consensus.cc:3060] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.748328 7768 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.748832 7768 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:54.750093 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0250841509464228af907fcb4f28dcae" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:54.750227 7574 raft_consensus.cc:3060] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.752167 7574 raft_consensus.cc:2468] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:54.752386 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0250841509464228af907fcb4f28dcae" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:54.752526 7296 raft_consensus.cc:3060] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.752558 7371 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:54.752768 7768 raft_consensus.cc:2804] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:54.752856 7768 raft_consensus.cc:697] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:00:54.753007 7768 consensus_queue.cc:237] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.753901 7296 raft_consensus.cc:2468] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:54.756323 7781 catalog_manager.cc:5671] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66). New cstate: current_term: 1 leader_uuid: "1be1472a04ae46e48d852d66903d9c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } }
I20260502 14:00:54.756608 7781 catalog_manager.cc:5763] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873) does not have the latest schema for tablet ca22b8c0f0384693bb0399b1b3319b87 (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]). Expected version 1 got 0
I20260502 14:00:54.756781 7781 catalog_manager.cc:5763] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873) does not have the latest schema for tablet 0250841509464228af907fcb4f28dcae (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]). Expected version 1 got 0
I20260502 14:00:54.762096 7697 raft_consensus.cc:493] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:54.762229 7697 raft_consensus.cc:515] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.762894 7697 leader_election.cc:290] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:54.763441 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b8e0ebe82440bf893a8712608d569b" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:54.763684 7434 raft_consensus.cc:2468] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:54.764098 7511 leader_election.cc:304] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:54.764973 7697 raft_consensus.cc:2804] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:54.765034 7697 raft_consensus.cc:493] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:54.765070 7697 raft_consensus.cc:3060] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.766072 7697 raft_consensus.cc:515] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.766461 7697 leader_election.cc:290] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:54.767020 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b8e0ebe82440bf893a8712608d569b" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:54.767148 7434 raft_consensus.cc:3060] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.768036 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b8e0ebe82440bf893a8712608d569b" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:54.768159 7297 raft_consensus.cc:3060] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.768646 7434 raft_consensus.cc:2468] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:54.769230 7511 leader_election.cc:304] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:54.769371 7297 raft_consensus.cc:2468] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:54.769435 7697 raft_consensus.cc:2804] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:54.769521 7697 raft_consensus.cc:697] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:00:54.769665 7697 consensus_queue.cc:237] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:54.772344 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b8e0ebe82440bf893a8712608d569b" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:54.772501 7296 raft_consensus.cc:2376] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1. Re-sending same reply.
I20260502 14:00:54.781002 7781 catalog_manager.cc:5671] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66). New cstate: current_term: 1 leader_uuid: "1be1472a04ae46e48d852d66903d9c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: UNKNOWN } } }
I20260502 14:00:54.781284 7781 catalog_manager.cc:5763] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873) does not have the latest schema for tablet 8fa858fb3eb243808f40536c334420be (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]). Expected version 1 got 0
I20260502 14:00:54.781430 7781 catalog_manager.cc:5671] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66). New cstate: current_term: 1 leader_uuid: "1be1472a04ae46e48d852d66903d9c84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } }
I20260502 14:00:54.781603 7781 catalog_manager.cc:5763] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873) does not have the latest schema for tablet 0250841509464228af907fcb4f28dcae (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]). Expected version 1 got 0
I20260502 14:00:54.794485 7781 catalog_manager.cc:5671] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67). New cstate: current_term: 1 leader_uuid: "c2964848cb1648a4bc2c1d671cc54f62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } }
I20260502 14:00:54.809700 7781 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47324:
table { table_name: "default.Table_e209f5be8519489e973e7a888ad911ee" } modify_external_catalogs: true
I20260502 14:00:54.809897 7781 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47324:
table { table_name: "default.Table_e209f5be8519489e973e7a888ad911ee" } modify_external_catalogs: true
I20260502 14:00:54.811993 7699 raft_consensus.cc:493] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:54.812139 7699 raft_consensus.cc:515] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:54.812619 7699 leader_election.cc:290] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:54.813169 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912c143ef13f42529ec28b08615db7dd" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:54.813318 7434 raft_consensus.cc:2468] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:54.813863 7511 leader_election.cc:304] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:54.814342 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912c143ef13f42529ec28b08615db7dd" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:54.814486 7296 raft_consensus.cc:2468] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:54.815217 7699 raft_consensus.cc:2804] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:54.815282 7699 raft_consensus.cc:493] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:54.815330 7699 raft_consensus.cc:3060] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.816656 7699 raft_consensus.cc:515] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:54.817102 7699 leader_election.cc:290] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:54.817497 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912c143ef13f42529ec28b08615db7dd" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:54.817629 7296 raft_consensus.cc:3060] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.817692 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "912c143ef13f42529ec28b08615db7dd" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:54.817829 7434 raft_consensus.cc:3060] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:54.818388 7296 raft_consensus.cc:2468] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:54.818790 7508 leader_election.cc:304] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:54.818794 7434 raft_consensus.cc:2468] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:54.818969 7699 raft_consensus.cc:2804] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:54.819041 7699 raft_consensus.cc:697] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:00:54.819182 7699 consensus_queue.cc:237] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:54.831054 7574 raft_consensus.cc:1275] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Refusing update from remote peer 1be1472a04ae46e48d852d66903d9c84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 14:00:54.831636 7708 consensus_queue.cc:1048] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:54.833523 7296 raft_consensus.cc:1275] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Refusing update from remote peer 1be1472a04ae46e48d852d66903d9c84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 14:00:54.834360 7708 consensus_queue.cc:1048] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:54.842043 7937 tablet.cc:1724] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 14:00:54.843763 7751 mvcc.cc:204] Tried to move back new op lower bound from 7281583942981316608 to 7281583942618386432. Current Snapshot: MvccSnapshot[applied={T|T < 7281583942981316608}]
I20260502 14:00:54.848826 7938 tablet.cc:1724] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 14:00:54.852792 7297 raft_consensus.cc:1275] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Refusing update from remote peer 1be1472a04ae46e48d852d66903d9c84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 14:00:54.853268 7701 consensus_queue.cc:1048] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:54.857934 7574 raft_consensus.cc:1275] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Refusing update from remote peer 1be1472a04ae46e48d852d66903d9c84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 14:00:54.859637 7701 consensus_queue.cc:1048] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:54.864789 7937 tablet.cc:1724] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 14:00:54.865864 7753 mvcc.cc:204] Tried to move back new op lower bound from 7281583943068131328 to 7281583942669869056. Current Snapshot: MvccSnapshot[applied={T|T < 7281583943068131328}]
I20260502 14:00:54.866845 7936 tablet.cc:1724] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 14:00:54.874820 7964 tablet.cc:1724] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 14:00:54.877038 7938 tablet.cc:1724] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 14:00:54.896353 7296 raft_consensus.cc:1275] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Refusing update from remote peer 1be1472a04ae46e48d852d66903d9c84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 14:00:54.896804 7574 raft_consensus.cc:1275] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Refusing update from remote peer 1be1472a04ae46e48d852d66903d9c84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260502 14:00:54.897521 7708 consensus_queue.cc:1048] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:54.897852 7708 consensus_queue.cc:1048] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:54.914490 7937 tablet.cc:1724] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 14:00:54.916568 7938 tablet.cc:1724] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 14:00:54.916687 7755 mvcc.cc:204] Tried to move back new op lower bound from 7281583943248486400 to 7281583942175318016. Current Snapshot: MvccSnapshot[applied={T|T < 7281583943248486400}]
I20260502 14:00:54.923097 7964 tablet.cc:1724] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260502 14:00:55.047351 7699 consensus_queue.cc:1048] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:55.060196 7697 consensus_queue.cc:1048] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:55.182317 7786 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]
I20260502 14:00:55.184121 7102 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]
I20260502 14:00:55.184633 7102 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:47700 (request call id 47) took 2266 ms. Trace:
I20260502 14:00:55.184706 7102 rpcz_store.cc:276] 0502 14:00:52.918201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:53.324967 (+406766us) service_pool.cc:224] Handling call
0502 14:00:53.531142 (+206175us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 14:00:55.184606 (+1653464us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":944444,"Hive Metastore.run_cpu_time_us":241,"Hive Metastore.run_wall_time_us":708246}
I20260502 14:00:55.221854 7697 consensus_queue.cc:1048] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:55.240869 7697 consensus_queue.cc:1048] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:55.241348 7697 consensus_queue.cc:1048] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:55.247575 7697 consensus_queue.cc:1048] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:55.314014 7097 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=c582269726e0451697a103262b5d83bf]
I20260502 14:00:55.314417 7097 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47700 (request call id 44) took 2508 ms. Trace:
I20260502 14:00:55.314491 7097 rpcz_store.cc:276] 0502 14:00:52.805496 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:52.945111 (+139615us) service_pool.cc:224] Handling call
0502 14:00:53.423667 (+478556us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 14:00:53.424028 (+ 361us) catalog_manager.cc:2147] Created new table and tablet info
0502 14:00:54.344667 (+920639us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 14:00:54.345378 (+ 711us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:54.345380 (+ 2us) write_op.cc:454] Released schema lock
0502 14:00:54.345574 (+ 194us) catalog_manager.cc:2181] Rolling back HMS table creation
0502 14:00:55.314392 (+968818us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 14:00:54.345265 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica a5d257c30a994bfdb03242b10606426f is not leader of this config: current role FOLLOWER)
0502 14:00:54.345278 (+ 13us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:54.345290 (+ 12us) write_op.cc:454] Released schema lock
0502 14:00:54.345294 (+ 4us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1717525,"Hive Metastore.run_cpu_time_us":473,"Hive Metastore.run_wall_time_us":171250,"child_traces":[["op",{}]]}
I20260502 14:00:55.329003 7975 raft_consensus.cc:493] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:00:55.329218 7975 raft_consensus.cc:515] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:55.330170 7044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 5 candidate_status { last_received { term: 4 index: 65 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80" is_pre_election: true
I20260502 14:00:55.330168 7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 5 candidate_status { last_received { term: 4 index: 65 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d" is_pre_election: true
I20260502 14:00:55.330678 7093 leader_election.cc:304] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5d257c30a994bfdb03242b10606426f; no voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d
I20260502 14:00:55.331017 7975 leader_election.cc:290] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147)
I20260502 14:00:55.331202 7975 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260502 14:00:55.333403 7788 catalog_manager.cc:3502] renamed table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15] in HMS: new name default.table_18b522eec8284015942366c63506ec7e
F20260502 14:00:55.345124 7850 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 19, previous 19; dumping first 4 out of 6 received events: NotificationEvent(eventId=17, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_5bbf52ba925f45dfae2bee0f411a0316, message={"server":"","servicePrincipal":"","db":"default","table":"table_5bbf52ba925f45dfae2bee0f411a0316","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5bbf52ba925f45dfae2bee0f411a0316\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_5bbf52ba925f45dfae2bee0f411a0316\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5bbf52ba925f45dfae2bee0f411a0316\",\"kudu.table_id\":\"2e0834670d044a0fbe32ffcd671a778b\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=18, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_916010ddd67a42689b76591a02784a0a, message={"server":"","servicePrincipal":"","db":"default","table":"table_916010ddd67a42689b76591a02784a0a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_916010ddd67a42689b76591a02784a0a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_916010ddd67a42689b76591a02784a0a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_916010ddd67a42689b76591a02784a0a\",\"kudu.table_id\":\"337d1a2589374574b8d3b1735b5efe95\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_79e5262b7980424fbe659116c4785e9c, message={"server":"","servicePrincipal":"","db":"default","table":"table_79e5262b7980424fbe659116c4785e9c","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79e5262b7980424fbe659116c4785e9c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730452},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_79e5262b7980424fbe659116c4785e9c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79e5262b7980424fbe659116c4785e9c\",\"kudu.table_id\":\"2b961b00f8804350ade31c5ac13105e3\",\"transient_lastDdlTime\":\"1777730452\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_2866c4520a3d40c4b3c6ca93424e5a0b, message={"server":"","servicePrincipal":"","db":"default","table":"table_2866c4520a3d40c4b3c6ca93424e5a0b","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730453},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2866c4520a3d40c4b3c6ca93424e5a0b\",\"kudu.table_id\":\"a6606215bcc24f789f81868248dcd065\",\"transient_lastDdlTime\":\"1777730453\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260502 14:00:55.361218 7106 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=8a2c0c92a3134a67977521b717f89a5a]
I20260502 14:00:55.361534 7106 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47700 (request call id 45) took 2527 ms. Trace:
I20260502 14:00:55.361594 7106 rpcz_store.cc:276] 0502 14:00:52.833739 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:53.080997 (+247258us) service_pool.cc:224] Handling call
0502 14:00:53.424413 (+343416us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 14:00:53.424709 (+ 296us) catalog_manager.cc:2147] Created new table and tablet info
0502 14:00:54.380865 (+956156us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 14:00:54.381512 (+ 647us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:54.381514 (+ 2us) write_op.cc:454] Released schema lock
0502 14:00:54.381672 (+ 158us) catalog_manager.cc:2181] Rolling back HMS table creation
0502 14:00:55.361510 (+979838us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 14:00:54.381459 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica a5d257c30a994bfdb03242b10606426f is not leader of this config: current role FOLLOWER)
0502 14:00:54.381467 (+ 8us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:54.381472 (+ 5us) write_op.cc:454] Released schema lock
0502 14:00:54.381475 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1852127,"Hive Metastore.run_cpu_time_us":443,"Hive Metastore.run_wall_time_us":83277,"child_traces":[["op",{}]]}
@ 0x7f0f4a2c2dcd google::LogMessage::Fail() at ??:0
@ 0x7f0f4a2c6b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f0f4a2c27cc google::LogMessage::Flush() at ??:0
@ 0x7f0f4a2c2a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7f0f4f836433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f0f4f83534a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f0f4f834aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 14:00:55.411037 7789 catalog_manager.cc:2174] created HMS catalog entry for table [id=2ecff91a2da84cc0948f5de7e361f968]
I20260502 14:00:55.424711 7789 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47324 (request call id 10) took 1005 ms. Trace:
I20260502 14:00:55.424826 7789 rpcz_store.cc:276] 0502 14:00:54.419260 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:54.422331 (+ 3071us) service_pool.cc:224] Handling call
0502 14:00:54.570384 (+148053us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 14:00:54.570938 (+ 554us) catalog_manager.cc:2147] Created new table and tablet info
0502 14:00:55.411024 (+840086us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 14:00:55.424491 (+ 13467us) catalog_manager.cc:2207] Wrote table and tablets to system table
0502 14:00:55.424596 (+ 105us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0502 14:00:55.424688 (+ 92us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 14:00:55.414585 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0502 14:00:55.414727 (+ 142us) write_op.cc:432] Acquiring schema lock in shared mode
0502 14:00:55.414732 (+ 5us) write_op.cc:435] Acquired schema lock
0502 14:00:55.414734 (+ 2us) tablet.cc:662] Decoding operations
0502 14:00:55.414818 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0502 14:00:55.414829 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0502 14:00:55.414833 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0502 14:00:55.414898 (+ 65us) tablet.cc:701] Row locks acquired
0502 14:00:55.414900 (+ 2us) write_op.cc:260] PREPARE: finished
0502 14:00:55.414941 (+ 41us) write_op.cc:270] Start()
0502 14:00:55.414974 (+ 33us) write_op.cc:276] Timestamp: P: 1777730455414925 usec, L: 0
0502 14:00:55.414976 (+ 2us) op_driver.cc:348] REPLICATION: starting
0502 14:00:55.415163 (+ 187us) log.cc:844] Serialized 432 byte log entry
0502 14:00:55.418782 (+ 3619us) op_driver.cc:464] REPLICATION: finished
0502 14:00:55.424069 (+ 5287us) write_op.cc:301] APPLY: starting
0502 14:00:55.424090 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0502 14:00:55.424128 (+ 38us) tablet.cc:1370] finished BulkCheckPresence
0502 14:00:55.424146 (+ 18us) tablet.cc:1372] starting ApplyRowOperation cycle
0502 14:00:55.424232 (+ 86us) tablet.cc:1383] finished ApplyRowOperation cycle
0502 14:00:55.424261 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0502 14:00:55.424266 (+ 5us) write_op.cc:312] APPLY: finished
0502 14:00:55.424340 (+ 74us) log.cc:844] Serialized 28 byte log entry
0502 14:00:55.424400 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:55.424417 (+ 17us) write_op.cc:454] Released schema lock
0502 14:00:55.424423 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":773869,"Hive Metastore.run_cpu_time_us":205,"Hive Metastore.run_wall_time_us":65973,"child_traces":[["op",{"apply.queue_time_us":5215,"num_ops":2,"prepare.queue_time_us":3003,"prepare.run_cpu_time_us":870,"prepare.run_wall_time_us":1436,"raft.queue_time_us":445,"raft.run_cpu_time_us":466,"raft.run_wall_time_us":474,"replication_time_us":3772,"thread_start_us":299,"threads_started":3}]]}
@ 0x7f0f4f83a1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x56186b608244 std::function<>::operator()() at ??:0
@ 0x7f0f4b7c77ea kudu::Thread::SuperviseThread() at ??:0
I20260502 14:00:55.433566 7269 tablet_service.cc:1511] Processing CreateTablet for tablet 13128c34905046aeb1f2130a0beb5c5f (DEFAULT_TABLE table=default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:55.433894 7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13128c34905046aeb1f2130a0beb5c5f. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f0f4c10b6db start_thread at ??:0
I20260502 14:00:55.437379 7408 tablet_service.cc:1511] Processing CreateTablet for tablet 13128c34905046aeb1f2130a0beb5c5f (DEFAULT_TABLE table=default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:55.437686 7408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13128c34905046aeb1f2130a0beb5c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:55.440598 7550 tablet_service.cc:1511] Processing CreateTablet for tablet 13128c34905046aeb1f2130a0beb5c5f (DEFAULT_TABLE table=default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:55.440927 7550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13128c34905046aeb1f2130a0beb5c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:55.444636 7789 catalog_manager.cc:5671] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67). New cstate: current_term: 1 leader_uuid: "c2964848cb1648a4bc2c1d671cc54f62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } health_report { overall_health: UNKNOWN } } }
I20260502 14:00:55.449018 7987 tablet_bootstrap.cc:492] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:55.452126 7099 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]
I20260502 14:00:55.452437 7099 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:47700 (request call id 50) took 2379 ms. Trace:
I20260502 14:00:55.452487 7987 tablet_bootstrap.cc:654] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:55.452492 7099 rpcz_store.cc:276] 0502 14:00:53.072965 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:53.644289 (+571324us) service_pool.cc:224] Handling call
0502 14:00:54.391960 (+747671us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0502 14:00:55.452425 (+1060465us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":969154,"Hive Metastore.run_cpu_time_us":129,"Hive Metastore.run_wall_time_us":90752}
@ 0x7f0f4947961f clone at ??:0
I20260502 14:00:55.458256 7992 tablet_bootstrap.cc:492] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:55.459649 7992 tablet_bootstrap.cc:654] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:55.460507 7993 tablet_bootstrap.cc:492] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:55.463454 7993 tablet_bootstrap.cc:654] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:55.465101 7987 tablet_bootstrap.cc:492] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:55.465196 7987 ts_tablet_manager.cc:1403] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260502 14:00:55.465862 7987 raft_consensus.cc:359] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:55.465975 7987 raft_consensus.cc:385] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:55.466001 7987 raft_consensus.cc:740] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:55.466142 7987 consensus_queue.cc:260] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:55.470639 7987 ts_tablet_manager.cc:1434] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260502 14:00:55.473714 7993 tablet_bootstrap.cc:492] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:55.473843 7993 ts_tablet_manager.cc:1403] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260502 14:00:55.474344 7993 raft_consensus.cc:359] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:55.474438 7993 raft_consensus.cc:385] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:55.474463 7993 raft_consensus.cc:740] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:55.474606 7993 consensus_queue.cc:260] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:55.475621 7993 ts_tablet_manager.cc:1434] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 14:00:55.476428 7992 tablet_bootstrap.cc:492] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:55.476516 7992 ts_tablet_manager.cc:1403] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20260502 14:00:55.476986 7992 raft_consensus.cc:359] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:55.477589 7992 raft_consensus.cc:385] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:55.477615 7992 raft_consensus.cc:740] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:55.477772 7992 consensus_queue.cc:260] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:55.479291 7992 ts_tablet_manager.cc:1434] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 14:00:55.523689 7104 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=2e0834670d044a0fbe32ffcd671a778b]
I20260502 14:00:55.524021 7104 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:47700 (request call id 46) took 2635 ms. Trace:
I20260502 14:00:55.524081 7104 rpcz_store.cc:276] 0502 14:00:52.888641 (+ 0us) service_pool.cc:167] Inserting onto call queue
0502 14:00:53.241132 (+352491us) service_pool.cc:224] Handling call
0502 14:00:53.530582 (+289450us) catalog_manager.cc:2101] Acquired catalog manager lock
0502 14:00:53.531009 (+ 427us) catalog_manager.cc:2147] Created new table and tablet info
0502 14:00:54.475846 (+944837us) catalog_manager.cc:2173] Created new table in HMS catalog
0502 14:00:54.476352 (+ 506us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:54.476353 (+ 1us) write_op.cc:454] Released schema lock
0502 14:00:54.476458 (+ 105us) catalog_manager.cc:2181] Rolling back HMS table creation
0502 14:00:55.523994 (+1047536us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0502 14:00:54.476309 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica a5d257c30a994bfdb03242b10606426f is not leader of this config: current role FOLLOWER)
0502 14:00:54.476316 (+ 7us) write_op.cc:489] Releasing partition, row and schema locks
0502 14:00:54.476320 (+ 4us) write_op.cc:454] Released schema lock
0502 14:00:54.476323 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1830056,"Hive Metastore.run_cpu_time_us":565,"Hive Metastore.run_wall_time_us":161580,"child_traces":[["op",{}]]}
W20260502 14:00:55.524760 7630 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.6.125.126:45121)
W20260502 14:00:55.725878 7370 connection.cc:570] server connection from 127.0.0.1:43520 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:00:55.725905 7629 connection.cc:570] client connection to 127.6.125.126:45121 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:00:55.726164 7629 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.6.125.126:45121)
W20260502 14:00:55.726442 7629 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.6.125.126:45121)
W20260502 14:00:55.726541 7020 connection.cc:570] client connection to 127.6.125.126:45121 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:00:55.726686 7629 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.6.125.126:45121)
I20260502 14:00:55.726676 7001 master_runner.cc:186] Error getting master registration for 127.6.125.126:45121: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107),
W20260502 14:00:55.726758 7091 connection.cc:570] client connection to 127.6.125.126:45121 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260502 14:00:55.726812 7001 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:00:55.726877 7072 master_runner.cc:186] Error getting master registration for 127.6.125.126:45121: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107),
I20260502 14:00:55.727005 7072 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:00:55.859959 7970 raft_consensus.cc:493] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:55.860088 7970 raft_consensus.cc:515] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:55.860488 7970 leader_election.cc:290] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:55.860970 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13128c34905046aeb1f2130a0beb5c5f" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:55.860970 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13128c34905046aeb1f2130a0beb5c5f" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:55.861114 7296 raft_consensus.cc:2468] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:55.861114 7434 raft_consensus.cc:2468] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:55.861431 7508 leader_election.cc:304] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:55.861603 7970 raft_consensus.cc:2804] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:55.861680 7970 raft_consensus.cc:493] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:55.861721 7970 raft_consensus.cc:3060] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:55.862567 7970 raft_consensus.cc:515] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:55.862946 7970 leader_election.cc:290] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:55.863328 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13128c34905046aeb1f2130a0beb5c5f" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:55.863328 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13128c34905046aeb1f2130a0beb5c5f" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:55.863488 7296 raft_consensus.cc:3060] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:55.863533 7434 raft_consensus.cc:3060] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:55.864492 7296 raft_consensus.cc:2468] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:55.864491 7434 raft_consensus.cc:2468] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:55.864858 7511 leader_election.cc:304] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:55.865027 7970 raft_consensus.cc:2804] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:55.865114 7970 raft_consensus.cc:697] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:00:55.865253 7970 consensus_queue.cc:237] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:55.951457 8011 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:00:55.951606 8011 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:55.952260 8011 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:00:55.952680 7020 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260502 14:00:55.952775 7116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 5 candidate_status { last_received { term: 4 index: 68 } } ignore_live_leader: false dest_uuid: "a5d257c30a994bfdb03242b10606426f" is_pre_election: true
W20260502 14:00:55.953519 7020 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
I20260502 14:00:55.953588 7020 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80; no voters: 9d590d630acd4892b59504b1c66c4f2d, a5d257c30a994bfdb03242b10606426f
I20260502 14:00:55.953783 8011 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260502 14:00:55.954473 8014 raft_consensus.cc:493] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:00:55.954576 8014 raft_consensus.cc:515] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:55.954990 8014 leader_election.cc:290] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147)
I20260502 14:00:55.955366 7044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 5 candidate_status { last_received { term: 4 index: 68 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80" is_pre_election: true
I20260502 14:00:55.955509 7044 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5d257c30a994bfdb03242b10606426f in term 4.
I20260502 14:00:55.955852 7093 leader_election.cc:304] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f; no voters:
W20260502 14:00:55.956243 7091 leader_election.cc:336] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
I20260502 14:00:55.956272 8014 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260502 14:00:55.956326 8014 raft_consensus.cc:493] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:00:55.956374 8014 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 4 FOLLOWER]: Advancing to term 5
I20260502 14:00:55.957281 8014 raft_consensus.cc:515] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:55.957619 8014 leader_election.cc:290] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 5 election: Requested vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147)
I20260502 14:00:55.958086 7044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 5 candidate_status { last_received { term: 4 index: 68 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80"
I20260502 14:00:55.958232 7044 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 4 FOLLOWER]: Advancing to term 5
W20260502 14:00:55.958786 7091 leader_election.cc:336] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
I20260502 14:00:55.959219 7044 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5d257c30a994bfdb03242b10606426f in term 5.
I20260502 14:00:55.959491 7093 leader_election.cc:304] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f; no voters: 9d590d630acd4892b59504b1c66c4f2d
I20260502 14:00:55.959683 8014 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 5 FOLLOWER]: Leader election won for term 5
I20260502 14:00:55.959911 8014 raft_consensus.cc:697] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 5 LEADER]: Becoming Leader. State: Replica: a5d257c30a994bfdb03242b10606426f, State: Running, Role: LEADER
I20260502 14:00:55.960067 8014 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 4.68, Last appended by leader: 68, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:55.960615 8017 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5d257c30a994bfdb03242b10606426f. Latest consensus state: current_term: 5 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:55.960705 8017 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: LEADER
I20260502 14:00:55.961010 8018 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 14:00:55.962695 8018 catalog_manager.cc:679] Loaded metadata for table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]
I20260502 14:00:55.962965 8018 catalog_manager.cc:679] Loaded metadata for table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]
I20260502 14:00:55.963327 8018 catalog_manager.cc:679] Loaded metadata for table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]
I20260502 14:00:55.963572 8018 catalog_manager.cc:679] Loaded metadata for table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]
I20260502 14:00:55.963761 8018 catalog_manager.cc:679] Loaded metadata for table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]
I20260502 14:00:55.963951 8018 catalog_manager.cc:679] Loaded metadata for table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]
I20260502 14:00:55.964128 8018 catalog_manager.cc:679] Loaded metadata for table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]
I20260502 14:00:55.964283 8018 catalog_manager.cc:679] Loaded metadata for table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]
I20260502 14:00:55.964432 8018 catalog_manager.cc:679] Loaded metadata for table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]
I20260502 14:00:55.964776 8018 catalog_manager.cc:679] Loaded metadata for table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]
I20260502 14:00:55.965000 8018 catalog_manager.cc:679] Loaded metadata for table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]
I20260502 14:00:55.965181 8018 catalog_manager.cc:679] Loaded metadata for table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]
I20260502 14:00:55.966032 8018 tablet_loader.cc:96] loaded metadata for tablet 0250841509464228af907fcb4f28dcae (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86])
I20260502 14:00:55.966230 8018 tablet_loader.cc:96] loaded metadata for tablet 13128c34905046aeb1f2130a0beb5c5f (table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968])
I20260502 14:00:55.966387 8018 tablet_loader.cc:96] loaded metadata for tablet 20b64fa709284798944325339eb67a0f (table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16])
I20260502 14:00:55.966548 8018 tablet_loader.cc:96] loaded metadata for tablet 21a36c9ca269417da55ad6d62428c620 (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a])
I20260502 14:00:55.966794 8018 tablet_loader.cc:96] loaded metadata for tablet 282c00536e1e4a708c32917582038281 (table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f])
I20260502 14:00:55.967098 8018 tablet_loader.cc:96] loaded metadata for tablet 769798507a234e7392d713d05f6d41d7 (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3])
I20260502 14:00:55.967396 8018 tablet_loader.cc:96] loaded metadata for tablet 8fa858fb3eb243808f40536c334420be (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e])
I20260502 14:00:55.967553 8018 tablet_loader.cc:96] loaded metadata for tablet 912c143ef13f42529ec28b08615db7dd (table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95])
I20260502 14:00:55.967703 8018 tablet_loader.cc:96] loaded metadata for tablet a8b8e0ebe82440bf893a8712608d569b (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065])
I20260502 14:00:55.967980 8018 tablet_loader.cc:96] loaded metadata for tablet c93263c445ad4872a7e33c9e22709300 (table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77])
I20260502 14:00:55.968151 8018 tablet_loader.cc:96] loaded metadata for tablet ca22b8c0f0384693bb0399b1b3319b87 (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504])
I20260502 14:00:55.968480 8018 tablet_loader.cc:96] loaded metadata for tablet e41f97896e774ff3bd7853d88ef93be0 (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15])
I20260502 14:00:55.968691 8018 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 14:00:55.969256 8018 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:00:55.969303 8018 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 14:00:55.969959 8018 catalog_manager.cc:1514] Loading token signing keys...
I20260502 14:00:55.970412 8018 catalog_manager.cc:6055] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Loaded TSK: 0
I20260502 14:00:55.970624 8018 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 14:00:55.971117 8018 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 14:00:55.971884 8018 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 16
I20260502 14:00:55.995534 7104 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_4534fe13c1d94c399d9c725c85deb6d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:55.995620 7099 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_ceee0100290949a6bc0c7926ef8c981e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:55.995954 7103 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_916010ddd67a42689b76591a02784a0a" } modify_external_catalogs: true
I20260502 14:00:55.995994 7097 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_7091f4920e384b37862f746b07e5372f" } modify_external_catalogs: true
I20260502 14:00:55.996014 7098 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_438fd981a3264fd58efe636b409acfb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:55.996066 7103 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_916010ddd67a42689b76591a02784a0a" } modify_external_catalogs: true
I20260502 14:00:55.996110 7097 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_7091f4920e384b37862f746b07e5372f" } modify_external_catalogs: true
I20260502 14:00:55.996223 7101 master_service.cc:954] ReplaceTablet: received request to replace tablet 769798507a234e7392d713d05f6d41d7 from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:55.996424 7106 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_5bbf52ba925f45dfae2bee0f411a0316"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:55.996635 7102 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_09d33df61a3f4a6480e2fe299421ae1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:55.996811 7105 master_service.cc:954] ReplaceTablet: received request to replace tablet a8b8e0ebe82440bf893a8712608d569b from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:55.996919 7100 master_service.cc:954] ReplaceTablet: received request to replace tablet 21a36c9ca269417da55ad6d62428c620 from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:55.999377 7044 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 5 FOLLOWER]: Refusing update from remote peer a5d257c30a994bfdb03242b10606426f: Log matching property violated. Preceding OpId in replica: term: 4 index: 68. Preceding OpId from leader: term: 5 index: 70. (index mismatch)
I20260502 14:00:55.999882 8014 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
W20260502 14:00:56.000277 7091 consensus_peers.cc:597] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f -> Peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Couldn't send request to peer 9d590d630acd4892b59504b1c66c4f2d. Status: Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260502 14:00:56.001964 8011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5d257c30a994bfdb03242b10606426f. Latest consensus state: current_term: 5 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:56.002092 8011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
F20260502 14:00:56.002486 7163 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 19, previous 19; dumping first 4 out of 10 received events: NotificationEvent(eventId=17, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_5bbf52ba925f45dfae2bee0f411a0316, message={"server":"","servicePrincipal":"","db":"default","table":"table_5bbf52ba925f45dfae2bee0f411a0316","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5bbf52ba925f45dfae2bee0f411a0316\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_5bbf52ba925f45dfae2bee0f411a0316\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5bbf52ba925f45dfae2bee0f411a0316\",\"kudu.table_id\":\"2e0834670d044a0fbe32ffcd671a778b\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=18, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_916010ddd67a42689b76591a02784a0a, message={"server":"","servicePrincipal":"","db":"default","table":"table_916010ddd67a42689b76591a02784a0a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_916010ddd67a42689b76591a02784a0a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_916010ddd67a42689b76591a02784a0a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_916010ddd67a42689b76591a02784a0a\",\"kudu.table_id\":\"337d1a2589374574b8d3b1735b5efe95\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_79e5262b7980424fbe659116c4785e9c, message={"server":"","servicePrincipal":"","db":"default","table":"table_79e5262b7980424fbe659116c4785e9c","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79e5262b7980424fbe659116c4785e9c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730452},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_79e5262b7980424fbe659116c4785e9c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79e5262b7980424fbe659116c4785e9c\",\"kudu.table_id\":\"2b961b00f8804350ade31c5ac13105e3\",\"transient_lastDdlTime\":\"1777730452\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_2866c4520a3d40c4b3c6ca93424e5a0b, message={"server":"","servicePrincipal":"","db":"default","table":"table_2866c4520a3d40c4b3c6ca93424e5a0b","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730453},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2866c4520a3d40c4b3c6ca93424e5a0b\",\"kudu.table_id\":\"a6606215bcc24f789f81868248dcd065\",\"transient_lastDdlTime\":\"1777730453\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260502 14:00:56.004242 8011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:56.004381 8011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:56.003496 8014 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:56.005086 8014 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: LEADER
@ 0x7f6b66e02dcd google::LogMessage::Fail() at ??:0
I20260502 14:00:56.007004 7101 catalog_manager.cc:5958] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Sending DeleteTablet for 3 replicas of tablet 769798507a234e7392d713d05f6d41d7
I20260502 14:00:56.007328 7101 catalog_manager.cc:6741] ReplaceTablet: tablet 769798507a234e7392d713d05f6d41d7 deleted and replaced by tablet 735a14bd06c1401a8e25e3a879048524
I20260502 14:00:56.007493 7101 master_service.cc:954] ReplaceTablet: received request to replace tablet e41f97896e774ff3bd7853d88ef93be0 from {username='slave'} at 127.0.0.1:47700
I20260502 14:00:56.007589 7550 tablet_service.cc:1558] Processing DeleteTablet for tablet 769798507a234e7392d713d05f6d41d7 with delete_type TABLET_DATA_DELETED (replaced by tablet 735a14bd06c1401a8e25e3a879048524) from {username='slave'} at 127.0.0.1:58268
I20260502 14:00:56.007619 7408 tablet_service.cc:1558] Processing DeleteTablet for tablet 769798507a234e7392d713d05f6d41d7 with delete_type TABLET_DATA_DELETED (replaced by tablet 735a14bd06c1401a8e25e3a879048524) from {username='slave'} at 127.0.0.1:43518
I20260502 14:00:56.007675 7269 tablet_service.cc:1558] Processing DeleteTablet for tablet 769798507a234e7392d713d05f6d41d7 with delete_type TABLET_DATA_DELETED (replaced by tablet 735a14bd06c1401a8e25e3a879048524) from {username='slave'} at 127.0.0.1:44408
I20260502 14:00:56.008327 7105 catalog_manager.cc:5958] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Sending DeleteTablet for 3 replicas of tablet a8b8e0ebe82440bf893a8712608d569b
I20260502 14:00:56.008846 7100 catalog_manager.cc:5958] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Sending DeleteTablet for 3 replicas of tablet 21a36c9ca269417da55ad6d62428c620
I20260502 14:00:56.008868 7550 tablet_service.cc:1558] Processing DeleteTablet for tablet a8b8e0ebe82440bf893a8712608d569b with delete_type TABLET_DATA_DELETED (replaced by tablet de191f3219804df9bb76291b8ec9e01d) from {username='slave'} at 127.0.0.1:58268
I20260502 14:00:56.009090 7100 catalog_manager.cc:6741] ReplaceTablet: tablet 21a36c9ca269417da55ad6d62428c620 deleted and replaced by tablet 4bb598ead00b4e199060f15d19eb9f9a
I20260502 14:00:56.009114 7105 catalog_manager.cc:6741] ReplaceTablet: tablet a8b8e0ebe82440bf893a8712608d569b deleted and replaced by tablet de191f3219804df9bb76291b8ec9e01d
I20260502 14:00:56.009296 7105 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_da5e1cd539c94420b562a58316eecee9" } new_table_name: "default.Table_af37839f6f694cdba90e61ecb647fd39" modify_external_catalogs: true
I20260502 14:00:56.009317 7100 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "default.Table_fb7cbf56a40a435aafcbd171a7e85925"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:56.009756 8029 tablet_replica.cc:333] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:56.009961 7550 tablet_service.cc:1558] Processing DeleteTablet for tablet 21a36c9ca269417da55ad6d62428c620 with delete_type TABLET_DATA_DELETED (replaced by tablet 4bb598ead00b4e199060f15d19eb9f9a) from {username='slave'} at 127.0.0.1:58268
I20260502 14:00:56.009968 7271 tablet_service.cc:1558] Processing DeleteTablet for tablet a8b8e0ebe82440bf893a8712608d569b with delete_type TABLET_DATA_DELETED (replaced by tablet de191f3219804df9bb76291b8ec9e01d) from {username='slave'} at 127.0.0.1:44408
I20260502 14:00:56.009897 8029 raft_consensus.cc:2243] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:56.010128 7269 tablet_service.cc:1558] Processing DeleteTablet for tablet 21a36c9ca269417da55ad6d62428c620 with delete_type TABLET_DATA_DELETED (replaced by tablet 4bb598ead00b4e199060f15d19eb9f9a) from {username='slave'} at 127.0.0.1:44408
@ 0x7f6b66e06b93 google::LogMessage::SendToLog() at ??:0
I20260502 14:00:56.010214 8029 raft_consensus.cc:2272] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.010526 7408 tablet_service.cc:1558] Processing DeleteTablet for tablet a8b8e0ebe82440bf893a8712608d569b with delete_type TABLET_DATA_DELETED (replaced by tablet de191f3219804df9bb76291b8ec9e01d) from {username='slave'} at 127.0.0.1:43518
I20260502 14:00:56.010546 7409 tablet_service.cc:1558] Processing DeleteTablet for tablet 21a36c9ca269417da55ad6d62428c620 with delete_type TABLET_DATA_DELETED (replaced by tablet 4bb598ead00b4e199060f15d19eb9f9a) from {username='slave'} at 127.0.0.1:43518
I20260502 14:00:56.010780 8028 tablet_replica.cc:333] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:00:56.010908 8028 raft_consensus.cc:2243] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:56.011217 8028 raft_consensus.cc:2272] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.011373 8027 tablet_replica.cc:333] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:56.012180 8027 raft_consensus.cc:2243] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:56.012328 8027 raft_consensus.cc:2272] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x7f6b66e027cc google::LogMessage::Flush() at ??:0
I20260502 14:00:56.012976 8027 ts_tablet_manager.cc:1916] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f6b66e02a11 google::LogMessage::~LogMessage() at ??:0
I20260502 14:00:56.018638 7269 tablet_service.cc:1511] Processing CreateTablet for tablet 735a14bd06c1401a8e25e3a879048524 (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.018954 7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 735a14bd06c1401a8e25e3a879048524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.019673 7101 catalog_manager.cc:5958] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Sending DeleteTablet for 3 replicas of tablet e41f97896e774ff3bd7853d88ef93be0
I20260502 14:00:56.019974 7101 catalog_manager.cc:6741] ReplaceTablet: tablet e41f97896e774ff3bd7853d88ef93be0 deleted and replaced by tablet b9cf00a840154a60bd394d960ee382ab
I20260502 14:00:56.020162 8029 ts_tablet_manager.cc:1916] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.020177 7101 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "default.Table_0d20cbe3e06443a39d25177f4abb4de7" } new_table_name: "default.Table_2ce27412960f42de9ef1fc0a234fae45" modify_external_catalogs: true
I20260502 14:00:56.021513 7548 tablet_service.cc:1558] Processing DeleteTablet for tablet e41f97896e774ff3bd7853d88ef93be0 with delete_type TABLET_DATA_DELETED (replaced by tablet b9cf00a840154a60bd394d960ee382ab) from {username='slave'} at 127.0.0.1:58268
I20260502 14:00:56.021611 7269 tablet_service.cc:1558] Processing DeleteTablet for tablet e41f97896e774ff3bd7853d88ef93be0 with delete_type TABLET_DATA_DELETED (replaced by tablet b9cf00a840154a60bd394d960ee382ab) from {username='slave'} at 127.0.0.1:44408
I20260502 14:00:56.021610 7409 tablet_service.cc:1511] Processing CreateTablet for tablet 735a14bd06c1401a8e25e3a879048524 (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.021767 8028 ts_tablet_manager.cc:1916] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.021804 7550 tablet_service.cc:1511] Processing CreateTablet for tablet 735a14bd06c1401a8e25e3a879048524 (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.021883 7409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 735a14bd06c1401a8e25e3a879048524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.022044 7550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 735a14bd06c1401a8e25e3a879048524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.024246 8028 ts_tablet_manager.cc:1929] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.024339 8028 log.cc:1199] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/769798507a234e7392d713d05f6d41d7
I20260502 14:00:56.024310 7408 tablet_service.cc:1558] Processing DeleteTablet for tablet e41f97896e774ff3bd7853d88ef93be0 with delete_type TABLET_DATA_DELETED (replaced by tablet b9cf00a840154a60bd394d960ee382ab) from {username='slave'} at 127.0.0.1:43518
@ 0x7f6b6c376433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 14:00:56.024756 8028 ts_tablet_manager.cc:1950] T 769798507a234e7392d713d05f6d41d7 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:00:56.025501 8028 tablet_replica.cc:333] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:00:56.025578 7093 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet 769798507a234e7392d713d05f6d41d7 (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]) successfully deleted
I20260502 14:00:56.025621 8028 raft_consensus.cc:2243] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:56.025801 8028 raft_consensus.cc:2272] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.028242 8029 ts_tablet_manager.cc:1929] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.028329 8029 log.cc:1199] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/769798507a234e7392d713d05f6d41d7
@ 0x7f6b6c37534a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 14:00:56.028611 8029 ts_tablet_manager.cc:1950] T 769798507a234e7392d713d05f6d41d7 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:56.029098 7269 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb598ead00b4e199060f15d19eb9f9a (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.029244 8029 tablet_replica.cc:333] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:56.029358 8029 raft_consensus.cc:2243] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:56.029452 8029 raft_consensus.cc:2272] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.029700 7271 tablet_service.cc:1511] Processing CreateTablet for tablet de191f3219804df9bb76291b8ec9e01d (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.029774 8033 tablet_bootstrap.cc:492] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:56.029901 7090 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet 769798507a234e7392d713d05f6d41d7 (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]) successfully deleted
I20260502 14:00:56.030201 7271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de191f3219804df9bb76291b8ec9e01d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.030890 8033 tablet_bootstrap.cc:654] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.031267 7408 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb598ead00b4e199060f15d19eb9f9a (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.031510 7408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb598ead00b4e199060f15d19eb9f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.031664 7550 tablet_service.cc:1511] Processing CreateTablet for tablet 4bb598ead00b4e199060f15d19eb9f9a (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.031782 8029 ts_tablet_manager.cc:1916] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.032115 7548 tablet_service.cc:1511] Processing CreateTablet for tablet de191f3219804df9bb76291b8ec9e01d (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.032356 7550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb598ead00b4e199060f15d19eb9f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.032474 7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb598ead00b4e199060f15d19eb9f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.033241 7548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de191f3219804df9bb76291b8ec9e01d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.033721 7409 tablet_service.cc:1511] Processing CreateTablet for tablet de191f3219804df9bb76291b8ec9e01d (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.033892 8032 tablet_bootstrap.cc:492] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:56.033955 7409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de191f3219804df9bb76291b8ec9e01d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.034272 8031 tablet_bootstrap.cc:492] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:56.034921 8032 tablet_bootstrap.cc:654] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.035813 8031 tablet_bootstrap.cc:654] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.036321 8027 ts_tablet_manager.cc:1929] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.036382 8027 log.cc:1199] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/769798507a234e7392d713d05f6d41d7
I20260502 14:00:56.036644 8027 ts_tablet_manager.cc:1950] T 769798507a234e7392d713d05f6d41d7 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:56.036815 8028 ts_tablet_manager.cc:1916] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.037276 8033 tablet_bootstrap.cc:492] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:56.037352 8033 ts_tablet_manager.cc:1403] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260502 14:00:56.037858 8033 raft_consensus.cc:359] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.037961 8033 raft_consensus.cc:385] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.037992 8033 raft_consensus.cc:740] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.038115 8033 consensus_queue.cc:260] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.038378 8033 ts_tablet_manager.cc:1434] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:00:56.038549 7482 heartbeater.cc:499] Master 127.6.125.124:43159 was elected leader, sending a full tablet report...
I20260502 14:00:56.039120 8032 tablet_bootstrap.cc:492] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:56.039196 8032 ts_tablet_manager.cc:1403] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260502 14:00:56.038563 8033 tablet_bootstrap.cc:492] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:56.039644 8032 raft_consensus.cc:359] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.039737 8032 raft_consensus.cc:385] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.039767 8032 raft_consensus.cc:740] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.039949 8032 consensus_queue.cc:260] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.040933 8033 tablet_bootstrap.cc:654] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.041541 8028 ts_tablet_manager.cc:1929] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.041602 8028 log.cc:1199] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/a8b8e0ebe82440bf893a8712608d569b
I20260502 14:00:56.041739 8032 ts_tablet_manager.cc:1434] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 14:00:56.041844 8028 ts_tablet_manager.cc:1950] T a8b8e0ebe82440bf893a8712608d569b P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
@ 0x7f6b6c374aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 14:00:56.042369 8028 tablet_replica.cc:333] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:00:56.042599 8028 raft_consensus.cc:2243] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:56.042644 7093 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet a8b8e0ebe82440bf893a8712608d569b (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]) successfully deleted
I20260502 14:00:56.042716 8028 raft_consensus.cc:2272] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.042855 8032 tablet_bootstrap.cc:492] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:56.043061 8028 ts_tablet_manager.cc:1916] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.044575 8032 tablet_bootstrap.cc:654] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
@ 0x7f6b6c37a1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x559e3872e244 std::function<>::operator()() at ??:0
I20260502 14:00:56.046231 8032 tablet_bootstrap.cc:492] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:56.046322 8032 ts_tablet_manager.cc:1403] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 14:00:56.046824 8032 raft_consensus.cc:359] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.046931 8032 raft_consensus.cc:385] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.046962 8032 raft_consensus.cc:740] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.047101 8032 consensus_queue.cc:260] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.047362 8032 ts_tablet_manager.cc:1434] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:56.047588 8032 tablet_bootstrap.cc:492] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:56.048094 7271 tablet_service.cc:1511] Processing CreateTablet for tablet b9cf00a840154a60bd394d960ee382ab (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.048550 7093 catalog_manager.cc:5002] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): tablet 769798507a234e7392d713d05f6d41d7 (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]) successfully deleted
I20260502 14:00:56.048671 8032 tablet_bootstrap.cc:654] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.048758 8027 tablet_replica.cc:333] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:56.048882 8027 raft_consensus.cc:2243] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:56.048970 8027 raft_consensus.cc:2272] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.049158 8028 ts_tablet_manager.cc:1929] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.049186 8029 ts_tablet_manager.cc:1929] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.049218 8028 log.cc:1199] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/21a36c9ca269417da55ad6d62428c620
I20260502 14:00:56.049257 8029 log.cc:1199] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/a8b8e0ebe82440bf893a8712608d569b
I20260502 14:00:56.049516 8029 ts_tablet_manager.cc:1950] T a8b8e0ebe82440bf893a8712608d569b P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:56.049458 8028 ts_tablet_manager.cc:1950] T 21a36c9ca269417da55ad6d62428c620 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:00:56.050233 8029 tablet_replica.cc:333] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:56.050357 8029 raft_consensus.cc:2243] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:56.050668 8029 raft_consensus.cc:2272] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.050774 8028 tablet_replica.cc:333] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:00:56.050894 8028 raft_consensus.cc:2243] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:56.050899 7409 tablet_service.cc:1511] Processing CreateTablet for tablet b9cf00a840154a60bd394d960ee382ab (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.051008 8028 raft_consensus.cc:2272] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.051193 7409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9cf00a840154a60bd394d960ee382ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.051251 8029 ts_tablet_manager.cc:1916] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.051343 8028 ts_tablet_manager.cc:1916] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.051808 7090 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet a8b8e0ebe82440bf893a8712608d569b (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]) successfully deleted
I20260502 14:00:56.052199 7271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9cf00a840154a60bd394d960ee382ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.052234 8031 tablet_bootstrap.cc:492] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:56.052304 8031 ts_tablet_manager.cc:1403] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.001s
I20260502 14:00:56.052987 8031 raft_consensus.cc:359] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.053092 8031 raft_consensus.cc:385] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.053121 8031 raft_consensus.cc:740] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.053238 8031 consensus_queue.cc:260] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.053769 7093 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet 21a36c9ca269417da55ad6d62428c620 (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]) successfully deleted
I20260502 14:00:56.053941 7550 tablet_service.cc:1511] Processing CreateTablet for tablet b9cf00a840154a60bd394d960ee382ab (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.054162 8027 ts_tablet_manager.cc:1916] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.054224 7550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9cf00a840154a60bd394d960ee382ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.055063 8031 ts_tablet_manager.cc:1434] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260502 14:00:56.055095 7344 heartbeater.cc:499] Master 127.6.125.124:43159 was elected leader, sending a full tablet report...
I20260502 14:00:56.055243 8031 tablet_bootstrap.cc:492] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:56.056421 8031 tablet_bootstrap.cc:654] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.056557 8028 ts_tablet_manager.cc:1929] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.056622 8028 log.cc:1199] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/e41f97896e774ff3bd7853d88ef93be0
I20260502 14:00:56.056871 8028 ts_tablet_manager.cc:1950] T e41f97896e774ff3bd7853d88ef93be0 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:00:56.056906 8027 ts_tablet_manager.cc:1929] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.056967 8027 log.cc:1199] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/a8b8e0ebe82440bf893a8712608d569b
I20260502 14:00:56.057170 8027 ts_tablet_manager.cc:1950] T a8b8e0ebe82440bf893a8712608d569b P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:56.057544 7093 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet e41f97896e774ff3bd7853d88ef93be0 (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]) successfully deleted
I20260502 14:00:56.057881 8032 tablet_bootstrap.cc:492] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:56.057964 8032 ts_tablet_manager.cc:1403] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260502 14:00:56.058315 8033 tablet_bootstrap.cc:492] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:56.058396 8033 ts_tablet_manager.cc:1403] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20260502 14:00:56.058517 8032 raft_consensus.cc:359] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.058620 8032 raft_consensus.cc:385] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.058650 8032 raft_consensus.cc:740] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.058775 8032 consensus_queue.cc:260] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.058912 8033 raft_consensus.cc:359] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.059007 8033 raft_consensus.cc:385] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.059037 8033 raft_consensus.cc:740] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.059046 8032 ts_tablet_manager.cc:1434] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:56.059157 8033 consensus_queue.cc:260] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.059242 8032 tablet_bootstrap.cc:492] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:56.059460 8033 ts_tablet_manager.cc:1434] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:56.059639 8033 tablet_bootstrap.cc:492] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:56.059624 8029 ts_tablet_manager.cc:1929] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.059689 8029 log.cc:1199] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/21a36c9ca269417da55ad6d62428c620
I20260502 14:00:56.059937 8029 ts_tablet_manager.cc:1950] T 21a36c9ca269417da55ad6d62428c620 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:56.060333 8032 tablet_bootstrap.cc:654] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.060617 8033 tablet_bootstrap.cc:654] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.062371 8032 tablet_bootstrap.cc:492] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:00:56.062558 8032 ts_tablet_manager.cc:1403] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:00:56.062577 8029 tablet_replica.cc:333] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:56.062558 7093 catalog_manager.cc:5002] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): tablet a8b8e0ebe82440bf893a8712608d569b (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]) successfully deleted
I20260502 14:00:56.062647 7090 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet 21a36c9ca269417da55ad6d62428c620 (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]) successfully deleted
I20260502 14:00:56.062707 8029 raft_consensus.cc:2243] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:56.062764 8027 tablet_replica.cc:333] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:56.062880 8027 raft_consensus.cc:2243] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:56.062891 8029 raft_consensus.cc:2272] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.062979 8027 raft_consensus.cc:2272] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.063040 8032 raft_consensus.cc:359] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.063131 8032 raft_consensus.cc:385] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.063161 8032 raft_consensus.cc:740] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.063290 8029 ts_tablet_manager.cc:1916] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.063285 8032 consensus_queue.cc:260] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.063330 8027 ts_tablet_manager.cc:1916] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f6b683077ea kudu::Thread::SuperviseThread() at ??:0
I20260502 14:00:56.063558 8032 ts_tablet_manager.cc:1434] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:56.064752 8033 tablet_bootstrap.cc:492] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:56.064831 8033 ts_tablet_manager.cc:1403] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260502 14:00:56.065464 8029 ts_tablet_manager.cc:1929] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.065621 8029 log.cc:1199] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/e41f97896e774ff3bd7853d88ef93be0
I20260502 14:00:56.065827 8033 raft_consensus.cc:359] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.065914 8029 ts_tablet_manager.cc:1950] T e41f97896e774ff3bd7853d88ef93be0 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:56.065923 8033 raft_consensus.cc:385] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.065950 8033 raft_consensus.cc:740] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.066062 8033 consensus_queue.cc:260] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.066320 8033 ts_tablet_manager.cc:1434] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:56.066395 8027 ts_tablet_manager.cc:1929] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.066447 8027 log.cc:1199] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/21a36c9ca269417da55ad6d62428c620
I20260502 14:00:56.066524 8033 tablet_bootstrap.cc:492] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:56.066660 8027 ts_tablet_manager.cc:1950] T 21a36c9ca269417da55ad6d62428c620 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:56.067515 8033 tablet_bootstrap.cc:654] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.067781 7093 catalog_manager.cc:5002] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): tablet 21a36c9ca269417da55ad6d62428c620 (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]) successfully deleted
I20260502 14:00:56.068006 8027 tablet_replica.cc:333] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:56.067793 7090 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet e41f97896e774ff3bd7853d88ef93be0 (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]) successfully deleted
I20260502 14:00:56.068122 8027 raft_consensus.cc:2243] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:56.068221 8027 raft_consensus.cc:2272] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x7f6b68c4b6db start_thread at ??:0
I20260502 14:00:56.068665 8027 ts_tablet_manager.cc:1916] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.068739 8033 tablet_bootstrap.cc:492] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:56.068802 8033 ts_tablet_manager.cc:1403] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260502 14:00:56.069229 8033 raft_consensus.cc:359] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.069321 8033 raft_consensus.cc:385] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.069350 8033 raft_consensus.cc:740] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.069489 8033 consensus_queue.cc:260] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.069828 8033 ts_tablet_manager.cc:1434] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:00:56.070550 8031 tablet_bootstrap.cc:492] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:56.070644 8031 ts_tablet_manager.cc:1403] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.001s
@ 0x7f6b65fb961f clone at ??:0
I20260502 14:00:56.071153 8031 raft_consensus.cc:359] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.071242 8031 raft_consensus.cc:385] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.071265 8031 raft_consensus.cc:740] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.071372 8031 consensus_queue.cc:260] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.071537 8027 ts_tablet_manager.cc:1929] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.071592 8027 log.cc:1199] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/e41f97896e774ff3bd7853d88ef93be0
I20260502 14:00:56.071635 8031 ts_tablet_manager.cc:1434] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260502 14:00:56.071825 8031 tablet_bootstrap.cc:492] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:56.073043 8031 tablet_bootstrap.cc:654] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.071872 8027 ts_tablet_manager.cc:1950] T e41f97896e774ff3bd7853d88ef93be0 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:56.074726 8031 tablet_bootstrap.cc:492] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:56.074800 8031 ts_tablet_manager.cc:1403] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:00:56.075213 8031 raft_consensus.cc:359] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.075294 8031 raft_consensus.cc:385] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.075312 8031 raft_consensus.cc:740] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.075410 8031 consensus_queue.cc:260] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.075647 8031 ts_tablet_manager.cc:1434] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:56.075805 8031 tablet_bootstrap.cc:492] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:56.076820 8031 tablet_bootstrap.cc:654] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.077867 8031 tablet_bootstrap.cc:492] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:56.077924 8031 ts_tablet_manager.cc:1403] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260502 14:00:56.078738 8031 raft_consensus.cc:359] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.078851 8031 raft_consensus.cc:385] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.078883 8031 raft_consensus.cc:740] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.078986 8031 consensus_queue.cc:260] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.079248 8031 ts_tablet_manager.cc:1434] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:56.115957 7970 raft_consensus.cc:493] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:56.116124 7970 raft_consensus.cc:515] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.116623 7970 leader_election.cc:290] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:56.117036 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735a14bd06c1401a8e25e3a879048524" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:56.117081 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735a14bd06c1401a8e25e3a879048524" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:56.117185 7296 raft_consensus.cc:2468] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:56.117195 7434 raft_consensus.cc:2468] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:56.117501 7508 leader_election.cc:304] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:56.117666 7970 raft_consensus.cc:2804] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:56.117717 7970 raft_consensus.cc:493] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:56.117744 7970 raft_consensus.cc:3060] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.118559 7970 raft_consensus.cc:515] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.118927 7970 leader_election.cc:290] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:56.119377 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735a14bd06c1401a8e25e3a879048524" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:56.119611 7296 raft_consensus.cc:3060] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.119392 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "735a14bd06c1401a8e25e3a879048524" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:56.119724 7434 raft_consensus.cc:3060] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.120553 7434 raft_consensus.cc:2468] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:56.120770 7296 raft_consensus.cc:2468] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:56.121129 7511 leader_election.cc:304] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:56.121348 7970 raft_consensus.cc:2804] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:56.121438 7970 raft_consensus.cc:697] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:00:56.121647 7970 consensus_queue.cc:237] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.149659 7974 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:56.149801 7974 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.150254 7974 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:56.150848 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de191f3219804df9bb76291b8ec9e01d" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:56.150882 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de191f3219804df9bb76291b8ec9e01d" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:56.150985 7434 raft_consensus.cc:2468] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:00:56.151043 7574 raft_consensus.cc:2468] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:00:56.151252 7233 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:56.151412 7974 raft_consensus.cc:2804] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:56.151477 7974 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:56.151516 7974 raft_consensus.cc:3060] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.152374 7974 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.152716 7974 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:56.153174 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de191f3219804df9bb76291b8ec9e01d" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:56.153174 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de191f3219804df9bb76291b8ec9e01d" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:56.153313 7434 raft_consensus.cc:3060] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.153319 7574 raft_consensus.cc:3060] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.154378 7434 raft_consensus.cc:2468] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:00:56.154379 7970 raft_consensus.cc:493] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:56.154378 7574 raft_consensus.cc:2468] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:00:56.154512 7970 raft_consensus.cc:515] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.154726 7233 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:56.154882 7970 leader_election.cc:290] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:56.155118 7974 raft_consensus.cc:2804] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:56.155206 7974 raft_consensus.cc:697] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:00:56.155339 7974 consensus_queue.cc:237] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.155416 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb598ead00b4e199060f15d19eb9f9a" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:56.155529 7296 raft_consensus.cc:2468] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:56.155759 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb598ead00b4e199060f15d19eb9f9a" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:56.155876 7434 raft_consensus.cc:2468] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:00:56.156191 7508 leader_election.cc:304] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:56.156446 7970 raft_consensus.cc:2804] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:56.156504 7970 raft_consensus.cc:493] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:56.156539 7970 raft_consensus.cc:3060] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.157557 7970 raft_consensus.cc:515] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.157936 7970 leader_election.cc:290] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:56.158484 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb598ead00b4e199060f15d19eb9f9a" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:56.158443 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bb598ead00b4e199060f15d19eb9f9a" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:56.158609 7296 raft_consensus.cc:3060] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.158689 7434 raft_consensus.cc:3060] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.159407 7434 raft_consensus.cc:2468] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:56.159571 7296 raft_consensus.cc:2468] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:00:56.159937 7508 leader_election.cc:304] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:56.160184 7970 raft_consensus.cc:2804] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:56.160275 7970 raft_consensus.cc:697] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:00:56.160422 7970 consensus_queue.cc:237] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.247932 7970 consensus_queue.cc:1048] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 14:00:56.249663 7371 connection.cc:570] server connection from 127.0.0.1:43518 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:00:56.251195 7630 connection.cc:570] client connection to 127.6.125.124:43159 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:00:56.253659 8006 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:00:56.250843 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.124:43159 (local address 127.6.125.65:50433)
0502 14:00:56.250991 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0502 14:00:56.251003 (+ 12us) client_negotiation.cc:175] Beginning negotiation
0502 14:00:56.251096 (+ 93us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:00:56.253083 (+ 1987us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":86}
W20260502 14:00:56.254261 8007 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:00:56.251031 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.124:43159 (local address 127.6.125.66:60615)
0502 14:00:56.251140 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0502 14:00:56.251152 (+ 12us) client_negotiation.cc:175] Beginning negotiation
0502 14:00:56.251238 (+ 86us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:00:56.253815 (+ 2577us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":41}
I20260502 14:00:56.255333 7970 consensus_queue.cc:1048] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 14:00:56.255575 8009 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:00:56.252731 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.124:43159 (local address 127.0.0.1:40444)
0502 14:00:56.253061 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0502 14:00:56.253074 (+ 13us) client_negotiation.cc:175] Beginning negotiation
0502 14:00:56.253153 (+ 79us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:00:56.254866 (+ 1713us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":79,"threads_started":1}
I20260502 14:00:56.362696 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--webserver_interface=127.6.125.126
--webserver_port=39397
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260502 14:00:56.425951 7768 raft_consensus.cc:493] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:56.426236 7768 raft_consensus.cc:515] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.426973 7768 leader_election.cc:290] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:56.427795 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cf00a840154a60bd394d960ee382ab" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:00:56.428001 7574 raft_consensus.cc:2468] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:56.427928 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cf00a840154a60bd394d960ee382ab" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:56.428185 7296 raft_consensus.cc:2468] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:56.428427 7371 leader_election.cc:304] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:00:56.428663 7768 raft_consensus.cc:2804] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:56.428714 7768 raft_consensus.cc:493] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:56.428751 7768 raft_consensus.cc:3060] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.429889 7768 raft_consensus.cc:515] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.430323 7768 leader_election.cc:290] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:56.430729 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cf00a840154a60bd394d960ee382ab" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:56.430778 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cf00a840154a60bd394d960ee382ab" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:00:56.430905 7574 raft_consensus.cc:3060] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.430908 7296 raft_consensus.cc:3060] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.431795 7296 raft_consensus.cc:2468] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:56.431924 7574 raft_consensus.cc:2468] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:56.432140 7368 leader_election.cc:304] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:56.432331 7768 raft_consensus.cc:2804] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:56.432518 7768 raft_consensus.cc:697] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:00:56.432683 7768 consensus_queue.cc:237] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
W20260502 14:00:56.484752 8067 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:00:56.485001 8067 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:00:56.485059 8067 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:00:56.488929 8067 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 14:00:56.489006 8067 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:00:56.489033 8067 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 14:00:56.489059 8067 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 14:00:56.493315 8067 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.125.126
--webserver_port=39397
--never_fsync=true
--heap_profile_path=/tmp/kudu.8067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:00:56.494486 8067 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:00:56.495643 8067 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:00:56.501698 8078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:56.501932 8076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:00:56.502475 8075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:00:56.502913 8067 server_base.cc:1061] running on GCE node
I20260502 14:00:56.503584 8067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:00:56.504779 8067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:00:56.505966 8067 hybrid_clock.cc:648] HybridClock initialized: now 1777730456505948 us; error 44 us; skew 500 ppm
I20260502 14:00:56.508291 8067 webserver.cc:492] Webserver started at http://127.6.125.126:39397/ using document root <none> and password file <none>
I20260502 14:00:56.508922 8067 fs_manager.cc:362] Metadata directory not provided
I20260502 14:00:56.508991 8067 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:00:56.513460 8067 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260502 14:00:56.516067 8084 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:00:56.517598 8067 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260502 14:00:56.517750 8067 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
uuid: "9d590d630acd4892b59504b1c66c4f2d"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:00:56.518195 8067 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:00:56.527534 8067 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:00:56.528460 8067 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:00:56.528712 8067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:00:56.538669 8067 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.126:45121
I20260502 14:00:56.538843 8136 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.126:45121 every 8 connection(s)
I20260502 14:00:56.540030 8067 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
I20260502 14:00:56.544883 8137 sys_catalog.cc:263] Verifying existing consensus state
I20260502 14:00:56.547573 8137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap starting.
I20260502 14:00:56.547933 8138 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:00:56.548038 8138 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:56.548580 8138 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:00:56.550194 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 8067
W20260502 14:00:56.550248 7021 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:00:56.562306 8137 log.cc:826] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Log is configured to *not* fsync() on all Append() calls
I20260502 14:00:56.571844 7970 consensus_queue.cc:1048] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:56.577579 7697 consensus_queue.cc:1048] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:56.579932 7343 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:00:56.584486 7621 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:00:56.588552 7481 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:00:56.608141 8137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=68 overwritten=0 applied=67 ignored=0} inserts{seen=42 ignored=0} mutations{seen=50 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260502 14:00:56.608693 8137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap complete.
I20260502 14:00:56.613633 8137 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 4 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:56.616216 8137 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d590d630acd4892b59504b1c66c4f2d, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.617100 8137 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 67, Last appended: 4.68, Last appended by leader: 68, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:56.617765 8151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:56.617941 8151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:56.618636 8137 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: configured and running, proceeding with master startup.
I20260502 14:00:56.618714 8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 6 candidate_status { last_received { term: 5 index: 76 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d" is_pre_election: true
I20260502 14:00:56.619043 8107 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78b194cad3b9424395e9a403da13ba80 in term 4.
I20260502 14:00:56.619427 7020 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters: a5d257c30a994bfdb03242b10606426f
I20260502 14:00:56.619652 8138 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260502 14:00:56.619725 8138 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:00:56.619767 8138 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 5 FOLLOWER]: Advancing to term 6
I20260502 14:00:56.620988 8138 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:56.621410 8138 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 6 election: Requested vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:00:56.621806 8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 6 candidate_status { last_received { term: 5 index: 76 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d"
I20260502 14:00:56.621932 8107 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 4 FOLLOWER]: Advancing to term 6
W20260502 14:00:56.623023 7021 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:00:56.624208 8107 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b194cad3b9424395e9a403da13ba80 in term 6.
I20260502 14:00:56.624756 7020 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters: a5d257c30a994bfdb03242b10606426f
I20260502 14:00:56.624965 8138 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 6 FOLLOWER]: Leader election won for term 6
I20260502 14:00:56.625182 8138 raft_consensus.cc:697] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 6 LEADER]: Becoming Leader. State: Replica: 78b194cad3b9424395e9a403da13ba80, State: Running, Role: LEADER
I20260502 14:00:56.625567 8138 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 5.76, Last appended by leader: 76, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:56.626587 8168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78b194cad3b9424395e9a403da13ba80. Latest consensus state: current_term: 6 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:56.626695 8168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: LEADER
I20260502 14:00:56.626997 8170 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 14:00:56.628152 8165 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:00:56.628268 8165 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: loading cluster ID for follower catalog manager: success
I20260502 14:00:56.628715 8170 catalog_manager.cc:679] Loaded metadata for table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]
I20260502 14:00:56.629096 8170 catalog_manager.cc:679] Loaded metadata for table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]
I20260502 14:00:56.629379 8170 catalog_manager.cc:679] Loaded metadata for table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]
I20260502 14:00:56.629696 8170 catalog_manager.cc:679] Loaded metadata for table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]
I20260502 14:00:56.629978 8170 catalog_manager.cc:679] Loaded metadata for table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]
I20260502 14:00:56.630249 8170 catalog_manager.cc:679] Loaded metadata for table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]
I20260502 14:00:56.630538 8170 catalog_manager.cc:679] Loaded metadata for table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]
I20260502 14:00:56.630949 8170 catalog_manager.cc:679] Loaded metadata for table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]
I20260502 14:00:56.631211 8170 catalog_manager.cc:679] Loaded metadata for table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]
I20260502 14:00:56.631486 8170 catalog_manager.cc:679] Loaded metadata for table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]
I20260502 14:00:56.631750 8170 catalog_manager.cc:679] Loaded metadata for table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]
I20260502 14:00:56.631763 8165 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: acquiring CA information for follower catalog manager: success
I20260502 14:00:56.632051 8170 catalog_manager.cc:679] Loaded metadata for table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]
I20260502 14:00:56.633404 8170 tablet_loader.cc:96] loaded metadata for tablet 0250841509464228af907fcb4f28dcae (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86])
I20260502 14:00:56.633749 8170 tablet_loader.cc:96] loaded metadata for tablet 13128c34905046aeb1f2130a0beb5c5f (table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968])
I20260502 14:00:56.636495 8165 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 14:00:56.644151 8170 tablet_loader.cc:96] loaded metadata for tablet 20b64fa709284798944325339eb67a0f (table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16])
I20260502 14:00:56.644742 8170 tablet_loader.cc:96] loaded metadata for tablet 282c00536e1e4a708c32917582038281 (table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f])
I20260502 14:00:56.645243 8170 tablet_loader.cc:96] loaded metadata for tablet 4bb598ead00b4e199060f15d19eb9f9a (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a])
I20260502 14:00:56.646106 8170 tablet_loader.cc:96] loaded metadata for tablet 735a14bd06c1401a8e25e3a879048524 (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3])
I20260502 14:00:56.655992 8170 tablet_loader.cc:96] loaded metadata for tablet 8fa858fb3eb243808f40536c334420be (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e])
I20260502 14:00:56.656369 8170 tablet_loader.cc:96] loaded metadata for tablet 912c143ef13f42529ec28b08615db7dd (table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95])
I20260502 14:00:56.656898 8170 tablet_loader.cc:96] loaded metadata for tablet b9cf00a840154a60bd394d960ee382ab (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15])
I20260502 14:00:56.657176 8170 tablet_loader.cc:96] loaded metadata for tablet c93263c445ad4872a7e33c9e22709300 (table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77])
I20260502 14:00:56.657423 8170 tablet_loader.cc:96] loaded metadata for tablet ca22b8c0f0384693bb0399b1b3319b87 (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504])
I20260502 14:00:56.657810 8170 tablet_loader.cc:96] loaded metadata for tablet de191f3219804df9bb76291b8ec9e01d (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065])
I20260502 14:00:56.658254 8170 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 14:00:56.659053 8170 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:00:56.659148 8170 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 14:00:56.660043 8170 catalog_manager.cc:1514] Loading token signing keys...
I20260502 14:00:56.660691 8170 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Loaded TSK: 0
I20260502 14:00:56.661445 8170 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 14:00:56.662108 8170 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 14:00:56.662750 8170 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 16
I20260502 14:00:56.661609 8067 master_runner.cc:186] Error getting master registration for 127.6.125.124:43159: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111),
I20260502 14:00:56.663640 8067 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:00:56.689471 7035 master_service.cc:954] ReplaceTablet: received request to replace tablet c93263c445ad4872a7e33c9e22709300 from {username='slave'} at 127.0.0.1:49118
I20260502 14:00:56.689589 7027 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49118:
table { table_name: "default.Table_e209f5be8519489e973e7a888ad911ee" } modify_external_catalogs: true
I20260502 14:00:56.689744 7027 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49118:
table { table_name: "default.Table_e209f5be8519489e973e7a888ad911ee" } modify_external_catalogs: true
I20260502 14:00:56.690143 7033 master_service.cc:954] ReplaceTablet: received request to replace tablet de191f3219804df9bb76291b8ec9e01d from {username='slave'} at 127.0.0.1:49118
I20260502 14:00:56.691159 7032 master_service.cc:954] ReplaceTablet: received request to replace tablet 4bb598ead00b4e199060f15d19eb9f9a from {username='slave'} at 127.0.0.1:49118
I20260502 14:00:56.691655 7028 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49118:
name: "default.Table_3803b7a44d4847adabbc5a04821f0382"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:56.691929 7031 master_service.cc:954] ReplaceTablet: received request to replace tablet a8b8e0ebe82440bf893a8712608d569b from {username='slave'} at 127.0.0.1:49118
I20260502 14:00:56.692389 7031 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49118:
name: "default.Table_afe9c083ff0b4d1487651533fee05e6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:56.692649 7030 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49118:
table { table_name: "default.Table_9c2adeda8ca24651b8be47c058c64d23" } new_table_name: "default.Table_a7e4568b673f4d569bb4a906a15952bf" modify_external_catalogs: true
I20260502 14:00:56.695004 8107 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Refusing update from remote peer 78b194cad3b9424395e9a403da13ba80: Log matching property violated. Preceding OpId in replica: term: 4 index: 68. Preceding OpId from leader: term: 6 index: 78. (index mismatch)
I20260502 14:00:56.695638 8168 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 67, Time since last communication: 0.000s
I20260502 14:00:56.696271 7026 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49118:
name: "default.Table_c3fa81d759a04db897e93aa688729318"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260502 14:00:56.697810 7021 consensus_peers.cc:597] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 -> Peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Couldn't send request to peer a5d257c30a994bfdb03242b10606426f. Status: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260502 14:00:56.689471 7029 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49118:
table { table_name: "default.Table_f0b8f5be35da4f878de056348eefee40" } new_table_name: "default.Table_e199b1aa26354ce2b3578613f359d8c3" modify_external_catalogs: true
I20260502 14:00:56.703351 8151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78b194cad3b9424395e9a403da13ba80. Latest consensus state: current_term: 6 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
F20260502 14:00:56.703433 7181 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 19, previous 19; dumping first 4 out of 10 received events: NotificationEvent(eventId=17, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_5bbf52ba925f45dfae2bee0f411a0316, message={"server":"","servicePrincipal":"","db":"default","table":"table_5bbf52ba925f45dfae2bee0f411a0316","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5bbf52ba925f45dfae2bee0f411a0316\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_5bbf52ba925f45dfae2bee0f411a0316\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5bbf52ba925f45dfae2bee0f411a0316\",\"kudu.table_id\":\"2e0834670d044a0fbe32ffcd671a778b\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=18, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_916010ddd67a42689b76591a02784a0a, message={"server":"","servicePrincipal":"","db":"default","table":"table_916010ddd67a42689b76591a02784a0a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_916010ddd67a42689b76591a02784a0a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_916010ddd67a42689b76591a02784a0a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_916010ddd67a42689b76591a02784a0a\",\"kudu.table_id\":\"337d1a2589374574b8d3b1735b5efe95\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_79e5262b7980424fbe659116c4785e9c, message={"server":"","servicePrincipal":"","db":"default","table":"table_79e5262b7980424fbe659116c4785e9c","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79e5262b7980424fbe659116c4785e9c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730452},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_79e5262b7980424fbe659116c4785e9c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79e5262b7980424fbe659116c4785e9c\",\"kudu.table_id\":\"2b961b00f8804350ade31c5ac13105e3\",\"transient_lastDdlTime\":\"1777730452\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_2866c4520a3d40c4b3c6ca93424e5a0b, message={"server":"","servicePrincipal":"","db":"default","table":"table_2866c4520a3d40c4b3c6ca93424e5a0b","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730453},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2866c4520a3d40c4b3c6ca93424e5a0b\",\"kudu.table_id\":\"a6606215bcc24f789f81868248dcd065\",\"transient_lastDdlTime\":\"1777730453\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive);
I20260502 14:00:56.703497 8151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:56.703595 8151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:56.703656 8151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
*** Check failure stack trace: ***
I20260502 14:00:56.705965 7034 master_service.cc:954] ReplaceTablet: received request to replace tablet 0250841509464228af907fcb4f28dcae from {username='slave'} at 127.0.0.1:49118
I20260502 14:00:56.707484 8150 mvcc.cc:204] Tried to move back new op lower bound from 7281583947937316864 to 7281583947613761536. Current Snapshot: MvccSnapshot[applied={T|T < 7281583947937316864}]
@ 0x7ff798c21dcd google::LogMessage::Fail() at ??:0
I20260502 14:00:56.710942 8138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:56.711071 8138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: LEADER
I20260502 14:00:56.712524 7032 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet 4bb598ead00b4e199060f15d19eb9f9a
@ 0x7ff798c25b93 google::LogMessage::SendToLog() at ??:0
I20260502 14:00:56.713750 7032 catalog_manager.cc:6741] ReplaceTablet: tablet 4bb598ead00b4e199060f15d19eb9f9a deleted and replaced by tablet 61a0294d54c941e98cbee66f5ac2c655
I20260502 14:00:56.713976 7032 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49118:
table { table_name: "default.Table_0912854d0fb44cf69bf731fbb257be24" } modify_external_catalogs: true
I20260502 14:00:56.714097 7032 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49118:
table { table_name: "default.Table_0912854d0fb44cf69bf731fbb257be24" } modify_external_catalogs: true
@ 0x7ff798c217cc google::LogMessage::Flush() at ??:0
I20260502 14:00:56.717613 7033 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet de191f3219804df9bb76291b8ec9e01d
I20260502 14:00:56.717921 7033 catalog_manager.cc:6741] ReplaceTablet: tablet de191f3219804df9bb76291b8ec9e01d deleted and replaced by tablet 303cc2525a0d44029b77fbbbf9f12ae1
I20260502 14:00:56.718120 7033 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49118:
table { table_name: "default.Table_d303c0450b934f2bb0f8ab01b92f2e67" } new_table_name: "default.Table_18b522eec8284015942366c63506ec7e" modify_external_catalogs: true
@ 0x7ff798c21a11 google::LogMessage::~LogMessage() at ??:0
I20260502 14:00:56.720135 8176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:00:56.720259 8176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:00:56.725286 7035 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet c93263c445ad4872a7e33c9e22709300
I20260502 14:00:56.725653 7035 catalog_manager.cc:6741] ReplaceTablet: tablet c93263c445ad4872a7e33c9e22709300 deleted and replaced by tablet 69d1158bbc864a9998326d5f45fead94
@ 0x7ff79e195433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 14:00:56.725909 7035 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49118:
name: "default.Table_116f97550c144f10bc14cc8c29c1d169"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:00:56.726552 7034 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet 0250841509464228af907fcb4f28dcae
I20260502 14:00:56.726612 7974 consensus_queue.cc:1048] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:56.726837 7034 catalog_manager.cc:6741] ReplaceTablet: tablet 0250841509464228af907fcb4f28dcae deleted and replaced by tablet 54df03f280ce41fda1d06bb316aaa33c
I20260502 14:00:56.727020 7034 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49118:
table { table_name: "default.Table_2866c4520a3d40c4b3c6ca93424e5a0b" } modify_external_catalogs: true
I20260502 14:00:56.727121 7034 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49118:
table { table_name: "default.Table_2866c4520a3d40c4b3c6ca93424e5a0b" } modify_external_catalogs: true
I20260502 14:00:56.729743 8100 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" instance_seqno: 1777730451385809) as {username='slave'} at 127.6.125.66:56243; Asking this server to re-register.
@ 0x7ff79e19434a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 14:00:56.731941 7481 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:56.733333 8100 ts_manager.cc:194] Registered new tserver with Master: 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
@ 0x7ff79e193aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
@ 0x7ff79e1991b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x55f26d97f244 std::function<>::operator()() at ??:0
I20260502 14:00:56.739413 7409 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bb598ead00b4e199060f15d19eb9f9a with delete_type TABLET_DATA_DELETED (replaced by tablet 61a0294d54c941e98cbee66f5ac2c655) from {username='slave'} at 127.0.0.1:40826
I20260502 14:00:56.739756 7408 tablet_service.cc:1558] Processing DeleteTablet for tablet de191f3219804df9bb76291b8ec9e01d with delete_type TABLET_DATA_DELETED (replaced by tablet 303cc2525a0d44029b77fbbbf9f12ae1) from {username='slave'} at 127.0.0.1:40826
I20260502 14:00:56.739982 7411 tablet_service.cc:1558] Processing DeleteTablet for tablet 0250841509464228af907fcb4f28dcae with delete_type TABLET_DATA_DELETED (replaced by tablet 54df03f280ce41fda1d06bb316aaa33c) from {username='slave'} at 127.0.0.1:40826
I20260502 14:00:56.740245 7412 tablet_service.cc:1511] Processing CreateTablet for tablet 61a0294d54c941e98cbee66f5ac2c655 (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.740554 7412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61a0294d54c941e98cbee66f5ac2c655. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7ff79a1267ea kudu::Thread::SuperviseThread() at ??:0
I20260502 14:00:56.743217 7413 tablet_service.cc:1511] Processing CreateTablet for tablet 54df03f280ce41fda1d06bb316aaa33c (DEFAULT_TABLE table=default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.743525 7413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54df03f280ce41fda1d06bb316aaa33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.745921 7414 tablet_service.cc:1511] Processing CreateTablet for tablet 69d1158bbc864a9998326d5f45fead94 (DEFAULT_TABLE table=default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.746179 7414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d1158bbc864a9998326d5f45fead94. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7ff79aa6a6db start_thread at ??:0
I20260502 14:00:56.747283 7271 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bb598ead00b4e199060f15d19eb9f9a with delete_type TABLET_DATA_DELETED (replaced by tablet 61a0294d54c941e98cbee66f5ac2c655) from {username='slave'} at 127.0.0.1:52292
I20260502 14:00:56.747577 7269 tablet_service.cc:1558] Processing DeleteTablet for tablet de191f3219804df9bb76291b8ec9e01d with delete_type TABLET_DATA_DELETED (replaced by tablet 303cc2525a0d44029b77fbbbf9f12ae1) from {username='slave'} at 127.0.0.1:52292
I20260502 14:00:56.747699 7272 tablet_service.cc:1558] Processing DeleteTablet for tablet c93263c445ad4872a7e33c9e22709300 with delete_type TABLET_DATA_DELETED (replaced by tablet 69d1158bbc864a9998326d5f45fead94) from {username='slave'} at 127.0.0.1:52292
I20260502 14:00:56.747798 7273 tablet_service.cc:1558] Processing DeleteTablet for tablet 0250841509464228af907fcb4f28dcae with delete_type TABLET_DATA_DELETED (replaced by tablet 54df03f280ce41fda1d06bb316aaa33c) from {username='slave'} at 127.0.0.1:52292
@ 0x7ff797dd861f clone at ??:0
I20260502 14:00:56.748103 7275 tablet_service.cc:1511] Processing CreateTablet for tablet 61a0294d54c941e98cbee66f5ac2c655 (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.748364 7275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61a0294d54c941e98cbee66f5ac2c655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.739936 7410 tablet_service.cc:1558] Processing DeleteTablet for tablet c93263c445ad4872a7e33c9e22709300 with delete_type TABLET_DATA_DELETED (replaced by tablet 69d1158bbc864a9998326d5f45fead94) from {username='slave'} at 127.0.0.1:40826
I20260502 14:00:56.739930 7409 tablet_service.cc:1511] Processing CreateTablet for tablet 303cc2525a0d44029b77fbbbf9f12ae1 (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.749274 7409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 303cc2525a0d44029b77fbbbf9f12ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.749349 7276 tablet_service.cc:1511] Processing CreateTablet for tablet 303cc2525a0d44029b77fbbbf9f12ae1 (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.749585 7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 303cc2525a0d44029b77fbbbf9f12ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.751502 7277 tablet_service.cc:1511] Processing CreateTablet for tablet 69d1158bbc864a9998326d5f45fead94 (DEFAULT_TABLE table=default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.751717 7277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d1158bbc864a9998326d5f45fead94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.752043 8100 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" instance_seqno: 1777730451168368) as {username='slave'} at 127.6.125.65:48587; Asking this server to re-register.
I20260502 14:00:56.752178 8055 consensus_queue.cc:1048] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:56.752556 7343 heartbeater.cc:461] Registering TS with master...
I20260502 14:00:56.752926 7697 consensus_queue.cc:1048] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:56.753690 8100 ts_manager.cc:194] Registered new tserver with Master: 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:56.753680 7274 tablet_service.cc:1511] Processing CreateTablet for tablet 54df03f280ce41fda1d06bb316aaa33c (DEFAULT_TABLE table=default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:00:56.753916 7274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54df03f280ce41fda1d06bb316aaa33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:56.756987 8193 tablet_bootstrap.cc:492] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:56.757496 8191 tablet_bootstrap.cc:492] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:56.758268 8193 tablet_bootstrap.cc:654] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.758710 8192 tablet_replica.cc:333] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:56.758977 8191 tablet_bootstrap.cc:654] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.759084 8192 raft_consensus.cc:2243] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:56.759341 8193 tablet_bootstrap.cc:492] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:56.759420 8193 ts_tablet_manager.cc:1403] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260502 14:00:56.759429 8192 pending_rounds.cc:70] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02: Trying to abort 1 pending ops.
I20260502 14:00:56.759545 8192 pending_rounds.cc:77] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7281583948434354176 op_type: NO_OP noop_request { }
I20260502 14:00:56.759620 8192 raft_consensus.cc:2889] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260502 14:00:56.759682 8192 raft_consensus.cc:2272] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.759979 8193 raft_consensus.cc:359] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:56.760072 8193 raft_consensus.cc:385] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.760100 8193 raft_consensus.cc:740] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.760197 8193 consensus_queue.cc:260] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:56.760459 8193 ts_tablet_manager.cc:1434] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:56.760625 8193 tablet_bootstrap.cc:492] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:56.761205 8100 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" instance_seqno: 1777730451630765) as {username='slave'} at 127.6.125.67:34001; Asking this server to re-register.
I20260502 14:00:56.761580 8193 tablet_bootstrap.cc:654] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.761782 7621 heartbeater.cc:461] Registering TS with master...
W20260502 14:00:56.762789 8196 consensus_queue.cc:1175] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4dacd17b49934d2c99a91c60aa672f02" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260502 14:00:56.762951 8100 ts_manager.cc:194] Registered new tserver with Master: c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:56.763244 8192 ts_tablet_manager.cc:1916] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.763437 8191 tablet_bootstrap.cc:492] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:56.763536 8191 ts_tablet_manager.cc:1403] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260502 14:00:56.764089 8191 raft_consensus.cc:359] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:56.764580 8191 raft_consensus.cc:385] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.764624 8191 raft_consensus.cc:740] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.764806 8191 consensus_queue.cc:260] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:56.765127 8190 tablet_replica.cc:333] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:56.765470 8192 ts_tablet_manager.cc:1929] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.765532 8192 log.cc:1199] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/4bb598ead00b4e199060f15d19eb9f9a
I20260502 14:00:56.765480 7970 consensus_queue.cc:1048] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:56.765777 8192 ts_tablet_manager.cc:1950] T 4bb598ead00b4e199060f15d19eb9f9a P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
W20260502 14:00:56.766700 7511 consensus_peers.cc:597] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
W20260502 14:00:56.766961 7508 consensus_peers.cc:597] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260502 14:00:56.767484 8193 tablet_bootstrap.cc:492] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:56.767561 8193 ts_tablet_manager.cc:1403] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260502 14:00:56.767807 8192 tablet_replica.cc:333] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:56.768069 8193 raft_consensus.cc:359] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.768162 8193 raft_consensus.cc:385] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.768191 8193 raft_consensus.cc:740] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.768314 8193 consensus_queue.cc:260] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.768573 8193 ts_tablet_manager.cc:1434] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:56.768756 8193 tablet_bootstrap.cc:492] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:56.769755 8193 tablet_bootstrap.cc:654] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.771750 8192 raft_consensus.cc:2243] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:56.772011 8192 raft_consensus.cc:2272] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.774255 8190 raft_consensus.cc:2243] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:56.774392 8190 raft_consensus.cc:2272] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.774776 8190 ts_tablet_manager.cc:1916] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.773084 8192 ts_tablet_manager.cc:1916] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.777212 8190 ts_tablet_manager.cc:1929] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260502 14:00:56.777282 8190 log.cc:1199] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/4bb598ead00b4e199060f15d19eb9f9a
I20260502 14:00:56.777518 8190 ts_tablet_manager.cc:1950] T 4bb598ead00b4e199060f15d19eb9f9a P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:56.777662 8191 ts_tablet_manager.cc:1434] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260502 14:00:56.778362 8190 tablet_replica.cc:333] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:56.778483 8190 raft_consensus.cc:2243] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:56.778621 8190 raft_consensus.cc:2272] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.778920 8192 ts_tablet_manager.cc:1929] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.778995 8192 log.cc:1199] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/de191f3219804df9bb76291b8ec9e01d
I20260502 14:00:56.779175 8190 ts_tablet_manager.cc:1916] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.779207 8192 ts_tablet_manager.cc:1950] T de191f3219804df9bb76291b8ec9e01d P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:56.780819 8191 tablet_bootstrap.cc:492] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:56.781210 8190 ts_tablet_manager.cc:1929] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.781272 8190 log.cc:1199] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/de191f3219804df9bb76291b8ec9e01d
I20260502 14:00:56.781522 8190 ts_tablet_manager.cc:1950] T de191f3219804df9bb76291b8ec9e01d P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:56.781888 8191 tablet_bootstrap.cc:654] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.782485 8190 tablet_replica.cc:333] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:56.782598 8190 raft_consensus.cc:2243] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:56.782780 8190 raft_consensus.cc:2272] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.783201 8190 ts_tablet_manager.cc:1916] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.783275 8193 tablet_bootstrap.cc:492] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:56.783363 8193 ts_tablet_manager.cc:1403] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260502 14:00:56.784155 8193 raft_consensus.cc:359] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.784271 8193 raft_consensus.cc:385] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.784300 8193 raft_consensus.cc:740] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.784416 8193 consensus_queue.cc:260] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.784703 8193 ts_tablet_manager.cc:1434] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260502 14:00:56.784895 8193 tablet_bootstrap.cc:492] T 54df03f280ce41fda1d06bb316aaa33c P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:00:56.785944 8193 tablet_bootstrap.cc:654] T 54df03f280ce41fda1d06bb316aaa33c P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.787042 8190 ts_tablet_manager.cc:1929] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 14:00:56.787108 8190 log.cc:1199] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/0250841509464228af907fcb4f28dcae
I20260502 14:00:56.787326 8190 ts_tablet_manager.cc:1950] T 0250841509464228af907fcb4f28dcae P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:56.788303 8192 tablet_replica.cc:333] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:56.788436 8192 raft_consensus.cc:2243] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:56.788532 8192 raft_consensus.cc:2272] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.788919 8192 ts_tablet_manager.cc:1916] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.789142 8191 tablet_bootstrap.cc:492] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:56.789229 8191 ts_tablet_manager.cc:1403] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260502 14:00:56.789723 8191 raft_consensus.cc:359] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.789826 8191 raft_consensus.cc:385] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.789855 8191 raft_consensus.cc:740] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.790030 8191 consensus_queue.cc:260] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.790318 8191 ts_tablet_manager.cc:1434] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260502 14:00:56.790501 8191 tablet_bootstrap.cc:492] T 69d1158bbc864a9998326d5f45fead94 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:56.791601 8192 ts_tablet_manager.cc:1929] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.791674 8192 log.cc:1199] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/c93263c445ad4872a7e33c9e22709300
I20260502 14:00:56.791781 8191 tablet_bootstrap.cc:654] T 69d1158bbc864a9998326d5f45fead94 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.792007 8192 ts_tablet_manager.cc:1950] T c93263c445ad4872a7e33c9e22709300 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:56.793001 8193 tablet_bootstrap.cc:492] T 54df03f280ce41fda1d06bb316aaa33c P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:00:56.793089 8193 ts_tablet_manager.cc:1403] T 54df03f280ce41fda1d06bb316aaa33c P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260502 14:00:56.793576 8193 raft_consensus.cc:359] T 54df03f280ce41fda1d06bb316aaa33c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.793689 8193 raft_consensus.cc:385] T 54df03f280ce41fda1d06bb316aaa33c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.793720 8193 raft_consensus.cc:740] T 54df03f280ce41fda1d06bb316aaa33c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.793844 8193 consensus_queue.cc:260] T 54df03f280ce41fda1d06bb316aaa33c P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.794104 8193 ts_tablet_manager.cc:1434] T 54df03f280ce41fda1d06bb316aaa33c P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:00:56.796329 8192 tablet_replica.cc:333] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:00:56.796478 8192 raft_consensus.cc:2243] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:00:56.796589 8192 raft_consensus.cc:2272] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.796988 8192 ts_tablet_manager.cc:1916] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.799436 8192 ts_tablet_manager.cc:1929] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 14:00:56.799525 8192 log.cc:1199] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/0250841509464228af907fcb4f28dcae
I20260502 14:00:56.799768 8192 ts_tablet_manager.cc:1950] T 0250841509464228af907fcb4f28dcae P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:00:56.800891 8190 tablet_replica.cc:333] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:00:56.801028 8190 raft_consensus.cc:2243] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:00:56.801137 8191 tablet_bootstrap.cc:492] T 69d1158bbc864a9998326d5f45fead94 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:56.801234 8191 ts_tablet_manager.cc:1403] T 69d1158bbc864a9998326d5f45fead94 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20260502 14:00:56.801752 8191 raft_consensus.cc:359] T 69d1158bbc864a9998326d5f45fead94 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.801868 8191 raft_consensus.cc:385] T 69d1158bbc864a9998326d5f45fead94 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.801898 8191 raft_consensus.cc:740] T 69d1158bbc864a9998326d5f45fead94 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.802057 8191 consensus_queue.cc:260] T 69d1158bbc864a9998326d5f45fead94 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.803864 8191 ts_tablet_manager.cc:1434] T 69d1158bbc864a9998326d5f45fead94 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260502 14:00:56.804756 8191 tablet_bootstrap.cc:492] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:00:56.805912 8191 tablet_bootstrap.cc:654] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:00:56.801234 8190 raft_consensus.cc:2272] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:00:56.806737 8190 ts_tablet_manager.cc:1916] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:00:56.807055 8191 tablet_bootstrap.cc:492] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:00:56.807138 8191 ts_tablet_manager.cc:1403] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260502 14:00:56.807613 8191 raft_consensus.cc:359] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.807716 8191 raft_consensus.cc:385] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:00:56.807756 8191 raft_consensus.cc:740] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:00:56.807966 8191 consensus_queue.cc:260] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.809442 8191 ts_tablet_manager.cc:1434] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 14:00:56.810422 8068 raft_consensus.cc:493] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:56.810503 8068 raft_consensus.cc:515] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.810868 8068 leader_election.cc:290] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:56.812623 8190 ts_tablet_manager.cc:1929] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:00:56.811678 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303cc2525a0d44029b77fbbbf9f12ae1" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:56.812690 8190 log.cc:1199] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/c93263c445ad4872a7e33c9e22709300
I20260502 14:00:56.812734 7296 raft_consensus.cc:2468] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:56.812618 8055 raft_consensus.cc:493] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:56.812930 8190 ts_tablet_manager.cc:1950] T c93263c445ad4872a7e33c9e22709300 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:00:56.812889 8055 raft_consensus.cc:515] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.813278 8055 leader_election.cc:290] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:56.813287 7368 leader_election.cc:304] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:00:56.813587 7768 raft_consensus.cc:493] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:56.813683 7768 raft_consensus.cc:515] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.813822 8068 raft_consensus.cc:2804] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:56.813879 8068 raft_consensus.cc:493] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:56.813912 8068 raft_consensus.cc:3060] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.814080 7768 leader_election.cc:290] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:00:56.814348 7371 leader_election.cc:343] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 303cc2525a0d44029b77fbbbf9f12ae1
I20260502 14:00:56.814909 8068 raft_consensus.cc:515] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.815002 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d1158bbc864a9998326d5f45fead94" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:00:56.815114 7434 raft_consensus.cc:2468] T 69d1158bbc864a9998326d5f45fead94 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:00:56.815255 8068 leader_election.cc:290] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:00:56.815771 7233 leader_election.cc:343] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 69d1158bbc864a9998326d5f45fead94
I20260502 14:00:56.815981 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df03f280ce41fda1d06bb316aaa33c" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:00:56.816090 7296 raft_consensus.cc:2468] T 54df03f280ce41fda1d06bb316aaa33c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:56.816254 7233 leader_election.cc:304] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters: c2964848cb1648a4bc2c1d671cc54f62
W20260502 14:00:56.816514 7371 leader_election.cc:343] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 303cc2525a0d44029b77fbbbf9f12ae1
W20260502 14:00:56.816776 7371 leader_election.cc:343] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 54df03f280ce41fda1d06bb316aaa33c
I20260502 14:00:56.816862 8055 raft_consensus.cc:2804] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:56.816917 8055 raft_consensus.cc:493] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:56.816953 8055 raft_consensus.cc:3060] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.817452 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "303cc2525a0d44029b77fbbbf9f12ae1" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:56.817565 7296 raft_consensus.cc:3060] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.818053 8055 raft_consensus.cc:515] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.818408 8055 leader_election.cc:290] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:56.818676 7296 raft_consensus.cc:2468] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:56.819106 7368 leader_election.cc:304] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters: c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:00:56.819213 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d1158bbc864a9998326d5f45fead94" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:00:56.819329 8068 raft_consensus.cc:2804] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:56.819356 7434 raft_consensus.cc:3060] T 69d1158bbc864a9998326d5f45fead94 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.819381 8068 raft_consensus.cc:493] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:56.819417 8068 raft_consensus.cc:3060] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.820287 7434 raft_consensus.cc:2468] T 69d1158bbc864a9998326d5f45fead94 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:00:56.820407 8068 raft_consensus.cc:515] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
W20260502 14:00:56.820721 7233 leader_election.cc:343] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 69d1158bbc864a9998326d5f45fead94
I20260502 14:00:56.820771 8068 leader_election.cc:290] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:00:56.821029 7368 leader_election.cc:304] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters: c2964848cb1648a4bc2c1d671cc54f62
W20260502 14:00:56.821852 7371 leader_election.cc:343] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 54df03f280ce41fda1d06bb316aaa33c
I20260502 14:00:56.822011 7233 leader_election.cc:304] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters: c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:00:56.822278 8068 raft_consensus.cc:2804] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:56.822357 8068 raft_consensus.cc:697] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:00:56.822497 8068 consensus_queue.cc:237] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.824826 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54df03f280ce41fda1d06bb316aaa33c" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:56.824970 7296 raft_consensus.cc:3060] T 54df03f280ce41fda1d06bb316aaa33c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.826023 7296 raft_consensus.cc:2468] T 54df03f280ce41fda1d06bb316aaa33c P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:56.827136 7368 leader_election.cc:304] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters: c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:00:56.827358 8055 raft_consensus.cc:2804] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:56.827373 7768 raft_consensus.cc:2804] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:56.827443 7768 raft_consensus.cc:697] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:00:56.827463 8055 raft_consensus.cc:697] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:00:56.827589 7768 consensus_queue.cc:237] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.827596 8055 consensus_queue.cc:237] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:56.844596 8068 raft_consensus.cc:493] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:00:56.844738 8068 raft_consensus.cc:515] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:56.845211 8068 leader_election.cc:290] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:56.846010 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0294d54c941e98cbee66f5ac2c655" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
W20260502 14:00:56.846057 7371 leader_election.cc:343] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 61a0294d54c941e98cbee66f5ac2c655
I20260502 14:00:56.846159 7296 raft_consensus.cc:2468] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:00:56.846504 7368 leader_election.cc:304] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters: c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:00:56.846737 8068 raft_consensus.cc:2804] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:00:56.846786 8068 raft_consensus.cc:493] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:00:56.846818 8068 raft_consensus.cc:3060] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.847885 8068 raft_consensus.cc:515] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
W20260502 14:00:56.848873 7371 leader_election.cc:343] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 61a0294d54c941e98cbee66f5ac2c655
I20260502 14:00:56.849371 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0294d54c941e98cbee66f5ac2c655" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:00:56.849506 7296 raft_consensus.cc:3060] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:00:56.851261 7296 raft_consensus.cc:2468] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:00:56.849562 8068 leader_election.cc:290] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:56.851873 7368 leader_election.cc:304] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters: c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:00:56.852584 8217 raft_consensus.cc:2804] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:00:56.853139 8217 raft_consensus.cc:697] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:00:56.853375 8217 consensus_queue.cc:237] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:56.916178 8217 consensus_queue.cc:1048] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:56.921891 8217 consensus_queue.cc:1048] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 14:00:56.966832 7511 connection.cc:570] client connection to 127.6.125.125:46147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:00:56.966827 7368 connection.cc:570] server connection from 127.0.0.1:40826 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:00:56.966863 7631 connection.cc:570] client connection to 127.6.125.125:46147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:00:56.967185 7233 connection.cc:570] client connection to 127.6.125.125:46147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:00:56.967314 7631 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.6.125.125:46147)
W20260502 14:00:56.967495 8186 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:00:56.714972 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:47956 (local address 127.6.125.67:34739)
0502 14:00:56.735673 (+ 20701us) server_negotiation.cc:207] Beginning negotiation
0502 14:00:56.735677 (+ 4us) server_negotiation.cc:400] Waiting for connection header
0502 14:00:56.735690 (+ 13us) server_negotiation.cc:408] Connection header received
0502 14:00:56.735752 (+ 62us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0502 14:00:56.735755 (+ 3us) server_negotiation.cc:462] Received NEGOTIATE request from client
0502 14:00:56.735802 (+ 47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0502 14:00:56.735910 (+ 108us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0502 14:00:56.738304 (+ 2394us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0502 14:00:56.754521 (+ 16217us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0502 14:00:56.966884 (+212363us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47956: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":20611,"thread_start_us":68,"threads_started":1}
W20260502 14:00:56.967620 7631 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.6.125.125:46147)
W20260502 14:00:56.967866 7631 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.6.125.125:46147)
W20260502 14:00:56.968145 7631 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.6.125.125:46147)
W20260502 14:00:56.969642 7231 connection.cc:570] server connection from 127.0.0.1:52292 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260502 14:00:57.234736 8222 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:00:57.234874 8222 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:57.236735 8222 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:00:57.237277 8088 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:00:57.238597 8087 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:00:57.238857 8088 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:00:57.238951 8088 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:00:57.239157 8222 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260502 14:00:57.257035 8217 consensus_queue.cc:1048] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 14:00:57.260669 7371 consensus_peers.cc:597] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84 -> Peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Couldn't send request to peer c2964848cb1648a4bc2c1d671cc54f62. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 54df03f280ce41fda1d06bb316aaa33c. This is attempt 1: this message will repeat every 5th retry.
W20260502 14:00:57.320992 7371 consensus_peers.cc:597] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 -> Peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Couldn't send request to peer c2964848cb1648a4bc2c1d671cc54f62. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 61a0294d54c941e98cbee66f5ac2c655. This is attempt 1: this message will repeat every 5th retry.
W20260502 14:00:57.366513 7371 consensus_peers.cc:597] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 -> Peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Couldn't send request to peer c2964848cb1648a4bc2c1d671cc54f62. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 303cc2525a0d44029b77fbbbf9f12ae1. This is attempt 1: this message will repeat every 5th retry.
I20260502 14:00:57.367329 8055 consensus_queue.cc:1048] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 14:00:57.369987 7233 consensus_peers.cc:597] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02 -> Peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Couldn't send request to peer c2964848cb1648a4bc2c1d671cc54f62. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 69d1158bbc864a9998326d5f45fead94. This is attempt 1: this message will repeat every 5th retry.
I20260502 14:00:57.379534 8217 consensus_queue.cc:1048] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:57.404145 7768 consensus_queue.cc:1048] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:00:57.760468 8234 ts_tablet_manager.cc:933] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62: Initiating tablet copy from peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:57.761073 8234 tablet_copy_client.cc:323] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Beginning tablet copy session from remote peer at address 127.6.125.66:41873
I20260502 14:00:57.762107 7455 tablet_copy_service.cc:140] P 1be1472a04ae46e48d852d66903d9c84: Received BeginTabletCopySession request for tablet 54df03f280ce41fda1d06bb316aaa33c from peer c2964848cb1648a4bc2c1d671cc54f62 ({username='slave'} at 127.6.125.67:38735)
I20260502 14:00:57.762324 7455 tablet_copy_service.cc:161] P 1be1472a04ae46e48d852d66903d9c84: Beginning new tablet copy session on tablet 54df03f280ce41fda1d06bb316aaa33c from peer c2964848cb1648a4bc2c1d671cc54f62 at {username='slave'} at 127.6.125.67:38735: session id = c2964848cb1648a4bc2c1d671cc54f62-54df03f280ce41fda1d06bb316aaa33c
I20260502 14:00:57.764209 8236 ts_tablet_manager.cc:933] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: Initiating tablet copy from peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:57.764284 7455 tablet_copy_source_session.cc:215] T 54df03f280ce41fda1d06bb316aaa33c P 1be1472a04ae46e48d852d66903d9c84: Tablet Copy: opened 0 blocks and 1 log segments
I20260502 14:00:57.764554 8236 tablet_copy_client.cc:323] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Beginning tablet copy session from remote peer at address 127.6.125.66:41873
I20260502 14:00:57.765373 7455 tablet_copy_service.cc:140] P 1be1472a04ae46e48d852d66903d9c84: Received BeginTabletCopySession request for tablet 61a0294d54c941e98cbee66f5ac2c655 from peer c2964848cb1648a4bc2c1d671cc54f62 ({username='slave'} at 127.6.125.67:38735)
I20260502 14:00:57.765515 7455 tablet_copy_service.cc:161] P 1be1472a04ae46e48d852d66903d9c84: Beginning new tablet copy session on tablet 61a0294d54c941e98cbee66f5ac2c655 from peer c2964848cb1648a4bc2c1d671cc54f62 at {username='slave'} at 127.6.125.67:38735: session id = c2964848cb1648a4bc2c1d671cc54f62-61a0294d54c941e98cbee66f5ac2c655
I20260502 14:00:57.766407 7455 tablet_copy_source_session.cc:215] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84: Tablet Copy: opened 0 blocks and 1 log segments
I20260502 14:00:57.766629 8234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54df03f280ce41fda1d06bb316aaa33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:57.767228 8236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61a0294d54c941e98cbee66f5ac2c655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:57.769323 8234 tablet_copy_client.cc:806] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 0 data blocks...
I20260502 14:00:57.769340 8236 tablet_copy_client.cc:806] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 0 data blocks...
I20260502 14:00:57.769551 8236 tablet_copy_client.cc:670] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 1 WAL segments...
I20260502 14:00:57.769583 8234 tablet_copy_client.cc:670] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 1 WAL segments...
I20260502 14:00:57.771384 8234 tablet_copy_client.cc:538] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260502 14:00:57.772266 8236 tablet_copy_client.cc:538] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260502 14:00:57.810079 8238 ts_tablet_manager.cc:933] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: Initiating tablet copy from peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:00:57.810516 8238 tablet_copy_client.cc:323] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Beginning tablet copy session from remote peer at address 127.6.125.66:41873
I20260502 14:00:57.811615 7454 tablet_copy_service.cc:140] P 1be1472a04ae46e48d852d66903d9c84: Received BeginTabletCopySession request for tablet 303cc2525a0d44029b77fbbbf9f12ae1 from peer c2964848cb1648a4bc2c1d671cc54f62 ({username='slave'} at 127.6.125.67:38735)
I20260502 14:00:57.811868 7454 tablet_copy_service.cc:161] P 1be1472a04ae46e48d852d66903d9c84: Beginning new tablet copy session on tablet 303cc2525a0d44029b77fbbbf9f12ae1 from peer c2964848cb1648a4bc2c1d671cc54f62 at {username='slave'} at 127.6.125.67:38735: session id = c2964848cb1648a4bc2c1d671cc54f62-303cc2525a0d44029b77fbbbf9f12ae1
I20260502 14:00:57.812893 7454 tablet_copy_source_session.cc:215] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84: Tablet Copy: opened 0 blocks and 1 log segments
I20260502 14:00:57.833292 8238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 303cc2525a0d44029b77fbbbf9f12ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:57.833920 8234 tablet_bootstrap.cc:492] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:57.834421 8236 tablet_bootstrap.cc:492] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:57.835786 8238 tablet_copy_client.cc:806] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 0 data blocks...
I20260502 14:00:57.836011 8238 tablet_copy_client.cc:670] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 1 WAL segments...
I20260502 14:00:57.837821 8238 tablet_copy_client.cc:538] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260502 14:00:57.857192 8236 tablet_bootstrap.cc:492] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:00:57.857192 8234 tablet_bootstrap.cc:492] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:00:57.857506 8236 tablet_bootstrap.cc:492] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap complete.
I20260502 14:00:57.857545 8234 tablet_bootstrap.cc:492] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap complete.
I20260502 14:00:57.857684 8236 ts_tablet_manager.cc:1403] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260502 14:00:57.857707 8234 ts_tablet_manager.cc:1403] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260502 14:00:57.858227 8234 raft_consensus.cc:359] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:57.858227 8236 raft_consensus.cc:359] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:57.858347 8234 raft_consensus.cc:740] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:57.858363 8236 raft_consensus.cc:740] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:57.858474 8234 consensus_queue.cc:260] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:57.858574 8236 consensus_queue.cc:260] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } }
I20260502 14:00:57.858855 8236 ts_tablet_manager.cc:1434] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260502 14:00:57.859304 8234 ts_tablet_manager.cc:1434] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 14:00:57.860337 7455 tablet_copy_service.cc:342] P 1be1472a04ae46e48d852d66903d9c84: Request end of tablet copy session c2964848cb1648a4bc2c1d671cc54f62-54df03f280ce41fda1d06bb316aaa33c received from {username='slave'} at 127.6.125.67:38735
I20260502 14:00:57.860574 7455 tablet_copy_service.cc:434] P 1be1472a04ae46e48d852d66903d9c84: ending tablet copy session c2964848cb1648a4bc2c1d671cc54f62-54df03f280ce41fda1d06bb316aaa33c on tablet 54df03f280ce41fda1d06bb316aaa33c with peer c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:00:57.860944 7454 tablet_copy_service.cc:342] P 1be1472a04ae46e48d852d66903d9c84: Request end of tablet copy session c2964848cb1648a4bc2c1d671cc54f62-61a0294d54c941e98cbee66f5ac2c655 received from {username='slave'} at 127.6.125.67:38735
I20260502 14:00:57.861018 7454 tablet_copy_service.cc:434] P 1be1472a04ae46e48d852d66903d9c84: ending tablet copy session c2964848cb1648a4bc2c1d671cc54f62-61a0294d54c941e98cbee66f5ac2c655 on tablet 61a0294d54c941e98cbee66f5ac2c655 with peer c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:00:57.879621 7697 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:00:57.879781 7697 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:57.880291 7697 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:00:57.881228 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:00:57.881435 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:00:57.881634 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:00:57.881841 7697 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:00:57.902849 8234 ts_tablet_manager.cc:933] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62: Initiating tablet copy from peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:00:57.903167 8234 tablet_copy_client.cc:323] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Beginning tablet copy session from remote peer at address 127.6.125.65:37597
I20260502 14:00:57.903861 7317 tablet_copy_service.cc:140] P 4dacd17b49934d2c99a91c60aa672f02: Received BeginTabletCopySession request for tablet 69d1158bbc864a9998326d5f45fead94 from peer c2964848cb1648a4bc2c1d671cc54f62 ({username='slave'} at 127.6.125.67:57099)
I20260502 14:00:57.904024 7317 tablet_copy_service.cc:161] P 4dacd17b49934d2c99a91c60aa672f02: Beginning new tablet copy session on tablet 69d1158bbc864a9998326d5f45fead94 from peer c2964848cb1648a4bc2c1d671cc54f62 at {username='slave'} at 127.6.125.67:57099: session id = c2964848cb1648a4bc2c1d671cc54f62-69d1158bbc864a9998326d5f45fead94
I20260502 14:00:57.905249 7317 tablet_copy_source_session.cc:215] T 69d1158bbc864a9998326d5f45fead94 P 4dacd17b49934d2c99a91c60aa672f02: Tablet Copy: opened 0 blocks and 1 log segments
I20260502 14:00:57.922956 8234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d1158bbc864a9998326d5f45fead94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:00:57.923506 8238 tablet_bootstrap.cc:492] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:57.925328 8234 tablet_copy_client.cc:806] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 0 data blocks...
I20260502 14:00:57.925477 8234 tablet_copy_client.cc:670] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 1 WAL segments...
I20260502 14:00:57.927024 8234 tablet_copy_client.cc:538] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260502 14:00:57.927662 8238 tablet_bootstrap.cc:492] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:00:57.927964 8238 tablet_bootstrap.cc:492] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap complete.
I20260502 14:00:57.928134 8238 ts_tablet_manager.cc:1403] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260502 14:00:57.928570 8234 tablet_bootstrap.cc:492] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:00:57.928701 8238 raft_consensus.cc:359] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:57.928809 8238 raft_consensus.cc:740] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:57.928944 8238 consensus_queue.cc:260] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:57.929247 8238 ts_tablet_manager.cc:1434] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:00:57.930008 7454 tablet_copy_service.cc:342] P 1be1472a04ae46e48d852d66903d9c84: Request end of tablet copy session c2964848cb1648a4bc2c1d671cc54f62-303cc2525a0d44029b77fbbbf9f12ae1 received from {username='slave'} at 127.6.125.67:38735
I20260502 14:00:57.930099 7454 tablet_copy_service.cc:434] P 1be1472a04ae46e48d852d66903d9c84: ending tablet copy session c2964848cb1648a4bc2c1d671cc54f62-303cc2525a0d44029b77fbbbf9f12ae1 on tablet 303cc2525a0d44029b77fbbbf9f12ae1 with peer c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:00:57.932502 8234 tablet_bootstrap.cc:492] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:00:57.932752 8234 tablet_bootstrap.cc:492] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap complete.
I20260502 14:00:57.932925 8234 ts_tablet_manager.cc:1403] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260502 14:00:57.933491 8234 raft_consensus.cc:359] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:57.933615 8234 raft_consensus.cc:740] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:00:57.933751 8234 consensus_queue.cc:260] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:57.934029 8234 ts_tablet_manager.cc:1434] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:00:57.934832 7317 tablet_copy_service.cc:342] P 4dacd17b49934d2c99a91c60aa672f02: Request end of tablet copy session c2964848cb1648a4bc2c1d671cc54f62-69d1158bbc864a9998326d5f45fead94 received from {username='slave'} at 127.6.125.67:57099
I20260502 14:00:57.934943 7317 tablet_copy_service.cc:434] P 4dacd17b49934d2c99a91c60aa672f02: ending tablet copy session c2964848cb1648a4bc2c1d671cc54f62-69d1158bbc864a9998326d5f45fead94 on tablet 69d1158bbc864a9998326d5f45fead94 with peer c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:00:57.969611 8249 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:00:57.969779 8249 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:57.970263 8249 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:00:57.971571 8087 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:00:57.972008 8088 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:00:57.972071 8088 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:00:57.972199 8249 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260502 14:00:58.207381 7574 raft_consensus.cc:1217] T 54df03f280ce41fda1d06bb316aaa33c P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260502 14:00:58.253930 7699 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:00:58.254060 7699 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:58.254468 7699 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:00:58.255101 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:00:58.255200 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:00:58.255300 7508 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:00:58.255434 7699 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:00:58.285135 7699 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:00:58.285306 7699 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:00:58.285823 7699 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:00:58.286580 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:00:58.286700 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:00:58.286777 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:00:58.286969 7699 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:00:58.307776 7574 raft_consensus.cc:1217] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260502 14:00:58.357379 7574 raft_consensus.cc:1217] T 69d1158bbc864a9998326d5f45fead94 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260502 14:00:58.388016 7574 raft_consensus.cc:1217] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260502 14:00:58.710424 8259 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:00:58.710620 8259 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:00:58.711041 8259 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:00:58.712451 8088 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:00:58.712598 8087 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:00:58.712729 8087 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:00:58.712900 8259 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260502 14:00:59.579264 7699 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:00:59.579422 7699 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:00:59.579922 7699 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:00:59.580646 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:00:59.580739 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:00:59.580842 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:00:59.580979 7699 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:00.020128 7970 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:00.020385 7970 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.020924 7970 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:00.021562 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:01:00.022094 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:01:00.022185 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:00.022334 7970 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:00.087546 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.125:46147
--webserver_interface=127.6.125.125
--webserver_port=34081
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260502 14:01:00.185742 8279 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:00.185959 8279 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:00.186285 7970 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:00.186435 7970 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.187014 8279 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:01:00.187139 7970 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:00.188030 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:01:00.188184 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:01:00.188259 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:00.188959 7970 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:01:00.189122 8088 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:00.189280 8087 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:00.189364 8087 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:00.189659 8279 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260502 14:01:00.230914 8278 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:01:00.231175 8278 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:01:00.231235 8278 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:01:00.234891 8278 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 14:01:00.234969 8278 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:01:00.234998 8278 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 14:01:00.235021 8278 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 14:01:00.241000 8278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.125:46147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.6.125.125
--webserver_port=34081
--never_fsync=true
--heap_profile_path=/tmp/kudu.8278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:01:00.243126 8278 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:01:00.245100 8278 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:01:00.252681 8287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:01:00.252681 8290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:01:00.252823 8288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:01:00.253158 8278 server_base.cc:1061] running on GCE node
I20260502 14:01:00.253684 8278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:01:00.254689 8278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:01:00.255857 8278 hybrid_clock.cc:648] HybridClock initialized: now 1777730460255836 us; error 39 us; skew 500 ppm
I20260502 14:01:00.257849 8278 webserver.cc:492] Webserver started at http://127.6.125.125:34081/ using document root <none> and password file <none>
I20260502 14:01:00.258641 8278 fs_manager.cc:362] Metadata directory not provided
I20260502 14:01:00.258737 8278 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:01:00.262317 8278 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260502 14:01:00.264586 8296 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:01:00.265856 8278 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260502 14:01:00.265982 8278 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
uuid: "78b194cad3b9424395e9a403da13ba80"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:01:00.266428 8278 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:01:00.279950 8278 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:01:00.280658 8278 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:01:00.280849 8278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:01:00.288648 8349 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.125:46147 every 8 connection(s)
I20260502 14:01:00.288650 8278 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.125:46147
I20260502 14:01:00.290109 8278 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/info.pb
I20260502 14:01:00.294458 8350 sys_catalog.cc:263] Verifying existing consensus state
I20260502 14:01:00.296582 8350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Bootstrap starting.
I20260502 14:01:00.297832 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 8278
I20260502 14:01:00.307000 8350 log.cc:826] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Log is configured to *not* fsync() on all Append() calls
I20260502 14:01:00.353688 8350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Bootstrap replayed 1/1 log segments. Stats: ops{read=83 overwritten=0 applied=83 ignored=0} inserts{seen=50 ignored=0} mutations{seen=67 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:01:00.354074 8350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Bootstrap complete.
I20260502 14:01:00.357016 8350 raft_consensus.cc:359] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:00.357383 8350 raft_consensus.cc:740] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b194cad3b9424395e9a403da13ba80, State: Initialized, Role: FOLLOWER
I20260502 14:01:00.357831 8350 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 83, Last appended: 6.83, Last appended by leader: 83, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:00.358299 8354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:00.358649 8354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:00.359138 8350 sys_catalog.cc:565] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: configured and running, proceeding with master startup.
I20260502 14:01:00.368350 7345 heartbeater.cc:344] Connected to a master server at 127.6.125.125:46147
I20260502 14:01:00.371336 8313 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" instance_seqno: 1777730451168368) as {username='slave'} at 127.6.125.65:42283; Asking this server to re-register.
I20260502 14:01:00.371865 8370 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:00.371958 8370 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: loading cluster ID for follower catalog manager: success
I20260502 14:01:00.372542 7345 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:00.374677 8370 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: acquiring CA information for follower catalog manager: success
I20260502 14:01:00.376138 8370 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 14:01:00.377200 8313 ts_manager.cc:194] Registered new tserver with Master: 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:00.388723 8278 master_runner.cc:186] Error getting master registration for 127.6.125.124:43159: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111),
I20260502 14:01:00.390590 8278 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:00.397083 7483 heartbeater.cc:344] Connected to a master server at 127.6.125.125:46147
I20260502 14:01:00.398540 8313 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" instance_seqno: 1777730451385809) as {username='slave'} at 127.6.125.66:48937; Asking this server to re-register.
I20260502 14:01:00.399075 7483 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:00.400318 8313 ts_manager.cc:194] Registered new tserver with Master: 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:00.440572 7623 heartbeater.cc:344] Connected to a master server at 127.6.125.125:46147
I20260502 14:01:00.443485 8313 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" instance_seqno: 1777730451630765) as {username='slave'} at 127.6.125.67:38833; Asking this server to re-register.
I20260502 14:01:00.445096 7623 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:00.446969 8313 ts_manager.cc:194] Registered new tserver with Master: c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:00.746161 8354 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:00.746390 8354 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:00.748070 8354 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:00.748517 8300 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:00.748518 8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 7 candidate_status { last_received { term: 6 index: 83 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d" is_pre_election: true
I20260502 14:01:00.748688 8107 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78b194cad3b9424395e9a403da13ba80 in term 6.
I20260502 14:01:00.749018 8299 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters:
I20260502 14:01:00.749264 8354 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260502 14:01:00.749341 8354 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:00.749387 8354 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 6 FOLLOWER]: Advancing to term 7
W20260502 14:01:00.749419 8300 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:00.751363 8354 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:00.751744 8354 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 7 election: Requested vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:01:00.752242 8107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 7 candidate_status { last_received { term: 6 index: 83 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d"
I20260502 14:01:00.752393 8107 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 6 FOLLOWER]: Advancing to term 7
W20260502 14:01:00.752794 8300 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:00.753376 8107 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b194cad3b9424395e9a403da13ba80 in term 7.
I20260502 14:01:00.753794 8299 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters: a5d257c30a994bfdb03242b10606426f
I20260502 14:01:00.753989 8354 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 7 FOLLOWER]: Leader election won for term 7
I20260502 14:01:00.754215 8354 raft_consensus.cc:697] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 7 LEADER]: Becoming Leader. State: Replica: 78b194cad3b9424395e9a403da13ba80, State: Running, Role: LEADER
I20260502 14:01:00.754544 8354 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 6.83, Last appended by leader: 83, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:00.756239 8384 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78b194cad3b9424395e9a403da13ba80. Latest consensus state: current_term: 7 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:00.756347 8384 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: LEADER
I20260502 14:01:00.756618 8386 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 14:01:00.758138 8386 catalog_manager.cc:679] Loaded metadata for table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]
I20260502 14:01:00.758440 8386 catalog_manager.cc:679] Loaded metadata for table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]
I20260502 14:01:00.758652 8386 catalog_manager.cc:679] Loaded metadata for table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]
I20260502 14:01:00.758870 8386 catalog_manager.cc:679] Loaded metadata for table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]
I20260502 14:01:00.759069 8386 catalog_manager.cc:679] Loaded metadata for table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]
I20260502 14:01:00.759258 8386 catalog_manager.cc:679] Loaded metadata for table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]
I20260502 14:01:00.759459 8386 catalog_manager.cc:679] Loaded metadata for table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]
I20260502 14:01:00.759650 8386 catalog_manager.cc:679] Loaded metadata for table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]
I20260502 14:01:00.759924 8386 catalog_manager.cc:679] Loaded metadata for table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]
I20260502 14:01:00.760138 8386 catalog_manager.cc:679] Loaded metadata for table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]
I20260502 14:01:00.760340 8386 catalog_manager.cc:679] Loaded metadata for table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]
I20260502 14:01:00.760547 8386 catalog_manager.cc:679] Loaded metadata for table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]
I20260502 14:01:00.761752 8386 tablet_loader.cc:96] loaded metadata for tablet 13128c34905046aeb1f2130a0beb5c5f (table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968])
I20260502 14:01:00.761935 8386 tablet_loader.cc:96] loaded metadata for tablet 20b64fa709284798944325339eb67a0f (table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16])
I20260502 14:01:00.762260 8386 tablet_loader.cc:96] loaded metadata for tablet 282c00536e1e4a708c32917582038281 (table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f])
I20260502 14:01:00.762423 8386 tablet_loader.cc:96] loaded metadata for tablet 303cc2525a0d44029b77fbbbf9f12ae1 (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065])
I20260502 14:01:00.762806 8386 tablet_loader.cc:96] loaded metadata for tablet 54df03f280ce41fda1d06bb316aaa33c (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86])
I20260502 14:01:00.762952 8386 tablet_loader.cc:96] loaded metadata for tablet 61a0294d54c941e98cbee66f5ac2c655 (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a])
I20260502 14:01:00.763103 8386 tablet_loader.cc:96] loaded metadata for tablet 69d1158bbc864a9998326d5f45fead94 (table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77])
I20260502 14:01:00.763248 8386 tablet_loader.cc:96] loaded metadata for tablet 735a14bd06c1401a8e25e3a879048524 (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3])
I20260502 14:01:00.763860 8386 tablet_loader.cc:96] loaded metadata for tablet 8fa858fb3eb243808f40536c334420be (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e])
I20260502 14:01:00.764220 8386 tablet_loader.cc:96] loaded metadata for tablet 912c143ef13f42529ec28b08615db7dd (table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95])
I20260502 14:01:00.764598 8386 tablet_loader.cc:96] loaded metadata for tablet b9cf00a840154a60bd394d960ee382ab (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15])
I20260502 14:01:00.764849 8386 tablet_loader.cc:96] loaded metadata for tablet ca22b8c0f0384693bb0399b1b3319b87 (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504])
I20260502 14:01:00.765311 8386 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 14:01:00.765928 8386 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:00.765977 8386 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 14:01:00.766688 8386 catalog_manager.cc:1514] Loading token signing keys...
I20260502 14:01:00.767307 8386 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Loaded TSK: 0
I20260502 14:01:00.768189 8386 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 14:01:00.768744 8386 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 14:01:00.769225 8386 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 16
I20260502 14:01:00.856710 8313 master_service.cc:954] ReplaceTablet: received request to replace tablet 61a0294d54c941e98cbee66f5ac2c655 from {username='slave'} at 127.0.0.1:44606
I20260502 14:01:00.856784 8314 master_service.cc:954] ReplaceTablet: received request to replace tablet 13128c34905046aeb1f2130a0beb5c5f from {username='slave'} at 127.0.0.1:44606
I20260502 14:01:00.857049 8312 master_service.cc:954] ReplaceTablet: received request to replace tablet b9cf00a840154a60bd394d960ee382ab from {username='slave'} at 127.0.0.1:44606
I20260502 14:01:00.857291 8309 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44606:
name: "default.Table_ceee0100290949a6bc0c7926ef8c981e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:00.857888 8308 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44606:
name: "default.Table_4534fe13c1d94c399d9c725c85deb6d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:00.858096 8310 master_service.cc:954] ReplaceTablet: received request to replace tablet 735a14bd06c1401a8e25e3a879048524 from {username='slave'} at 127.0.0.1:44606
I20260502 14:01:00.857919 8306 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44606:
table { table_name: "default.Table_7091f4920e384b37862f746b07e5372f" } modify_external_catalogs: true
I20260502 14:01:00.858197 8306 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44606:
table { table_name: "default.Table_7091f4920e384b37862f746b07e5372f" } modify_external_catalogs: true
I20260502 14:01:00.858062 8305 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44606:
name: "default.Table_09d33df61a3f4a6480e2fe299421ae1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:00.858402 8311 master_service.cc:954] ReplaceTablet: received request to replace tablet 61a0294d54c941e98cbee66f5ac2c655 from {username='slave'} at 127.0.0.1:44606
I20260502 14:01:00.857306 8307 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44606:
name: "default.Table_5bbf52ba925f45dfae2bee0f411a0316"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:00.861169 8107 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Refusing update from remote peer 78b194cad3b9424395e9a403da13ba80: Log matching property violated. Preceding OpId in replica: term: 6 index: 83. Preceding OpId from leader: term: 7 index: 85. (index mismatch)
I20260502 14:01:00.861723 8384 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
W20260502 14:01:00.863255 8300 consensus_peers.cc:597] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 -> Peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Couldn't send request to peer a5d257c30a994bfdb03242b10606426f. Status: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260502 14:01:00.863940 8389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78b194cad3b9424395e9a403da13ba80. Latest consensus state: current_term: 7 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:00.864061 8389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
F20260502 14:01:00.865527 8369 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 19, previous 19; dumping first 4 out of 10 received events: NotificationEvent(eventId=17, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_5bbf52ba925f45dfae2bee0f411a0316, message={"server":"","servicePrincipal":"","db":"default","table":"table_5bbf52ba925f45dfae2bee0f411a0316","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5bbf52ba925f45dfae2bee0f411a0316\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_5bbf52ba925f45dfae2bee0f411a0316\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5bbf52ba925f45dfae2bee0f411a0316\",\"kudu.table_id\":\"2e0834670d044a0fbe32ffcd671a778b\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=18, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_916010ddd67a42689b76591a02784a0a, message={"server":"","servicePrincipal":"","db":"default","table":"table_916010ddd67a42689b76591a02784a0a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_916010ddd67a42689b76591a02784a0a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_916010ddd67a42689b76591a02784a0a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_916010ddd67a42689b76591a02784a0a\",\"kudu.table_id\":\"337d1a2589374574b8d3b1735b5efe95\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_79e5262b7980424fbe659116c4785e9c, message={"server":"","servicePrincipal":"","db":"default","table":"table_79e5262b7980424fbe659116c4785e9c","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79e5262b7980424fbe659116c4785e9c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730452},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_79e5262b7980424fbe659116c4785e9c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79e5262b7980424fbe659116c4785e9c\",\"kudu.table_id\":\"2b961b00f8804350ade31c5ac13105e3\",\"transient_lastDdlTime\":\"1777730452\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_2866c4520a3d40c4b3c6ca93424e5a0b, message={"server":"","servicePrincipal":"","db":"default","table":"table_2866c4520a3d40c4b3c6ca93424e5a0b","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730453},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2866c4520a3d40c4b3c6ca93424e5a0b\",\"kudu.table_id\":\"a6606215bcc24f789f81868248dcd065\",\"transient_lastDdlTime\":\"1777730453\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260502 14:01:00.866104 8384 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:00.866220 8384 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: LEADER
I20260502 14:01:00.866839 8389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:00.866940 8389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:00.868412 8312 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet b9cf00a840154a60bd394d960ee382ab
@ 0x7fa64782edcd google::LogMessage::Fail() at ??:0
I20260502 14:01:00.870093 8312 catalog_manager.cc:6741] ReplaceTablet: tablet b9cf00a840154a60bd394d960ee382ab deleted and replaced by tablet 5dc5c4248379441595cc3e5f8c8690e4
I20260502 14:01:00.870460 8312 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44606:
table { table_name: "default.Table_916010ddd67a42689b76591a02784a0a" } modify_external_catalogs: true
I20260502 14:01:00.870589 8312 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44606:
table { table_name: "default.Table_916010ddd67a42689b76591a02784a0a" } modify_external_catalogs: true
I20260502 14:01:00.871415 8313 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet 61a0294d54c941e98cbee66f5ac2c655
I20260502 14:01:00.871567 8314 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet 13128c34905046aeb1f2130a0beb5c5f
I20260502 14:01:00.871809 8313 catalog_manager.cc:6741] ReplaceTablet: tablet 61a0294d54c941e98cbee66f5ac2c655 deleted and replaced by tablet a1e9410673c743bdbe0b0a6cabdbbac3
I20260502 14:01:00.871845 8314 catalog_manager.cc:6741] ReplaceTablet: tablet 13128c34905046aeb1f2130a0beb5c5f deleted and replaced by tablet 1ee6e9e5b45444a883171cc483e8a4ca
I20260502 14:01:00.872175 8313 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44606:
name: "default.Table_438fd981a3264fd58efe636b409acfb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:00.872253 8314 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44606:
name: "default.Table_fb7cbf56a40a435aafcbd171a7e85925"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:00.872588 8310 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet 735a14bd06c1401a8e25e3a879048524
I20260502 14:01:00.872818 8310 catalog_manager.cc:6741] ReplaceTablet: tablet 735a14bd06c1401a8e25e3a879048524 deleted and replaced by tablet b67a5c0fd2ad49fc8a8f9550567de239
I20260502 14:01:00.872794 8311 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44606:
table { table_name: "default.Table_da5e1cd539c94420b562a58316eecee9" } new_table_name: "default.Table_af37839f6f694cdba90e61ecb647fd39" modify_external_catalogs: true
I20260502 14:01:00.872975 8310 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44606:
table { table_name: "default.Table_f0b8f5be35da4f878de056348eefee40" } new_table_name: "default.Table_e199b1aa26354ce2b3578613f359d8c3" modify_external_catalogs: true
@ 0x7fa647832b93 google::LogMessage::SendToLog() at ??:0
@ 0x7fa64782e7cc google::LogMessage::Flush() at ??:0
I20260502 14:01:00.879415 7414 tablet_service.cc:1558] Processing DeleteTablet for tablet 61a0294d54c941e98cbee66f5ac2c655 with delete_type TABLET_DATA_DELETED (replaced by tablet a1e9410673c743bdbe0b0a6cabdbbac3) from {username='slave'} at 127.0.0.1:40832
I20260502 14:01:00.879526 7409 tablet_service.cc:1558] Processing DeleteTablet for tablet b9cf00a840154a60bd394d960ee382ab with delete_type TABLET_DATA_DELETED (replaced by tablet 5dc5c4248379441595cc3e5f8c8690e4) from {username='slave'} at 127.0.0.1:40832
I20260502 14:01:00.880134 7413 tablet_service.cc:1558] Processing DeleteTablet for tablet 735a14bd06c1401a8e25e3a879048524 with delete_type TABLET_DATA_DELETED (replaced by tablet b67a5c0fd2ad49fc8a8f9550567de239) from {username='slave'} at 127.0.0.1:40832
I20260502 14:01:00.880267 7410 tablet_service.cc:1558] Processing DeleteTablet for tablet 13128c34905046aeb1f2130a0beb5c5f with delete_type TABLET_DATA_DELETED (replaced by tablet 1ee6e9e5b45444a883171cc483e8a4ca) from {username='slave'} at 127.0.0.1:40832
@ 0x7fa64782ea11 google::LogMessage::~LogMessage() at ??:0
I20260502 14:01:00.882988 7410 tablet_service.cc:1511] Processing CreateTablet for tablet a1e9410673c743bdbe0b0a6cabdbbac3 (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:00.883301 7410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e9410673c743bdbe0b0a6cabdbbac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:00.886083 7550 tablet_service.cc:1558] Processing DeleteTablet for tablet b9cf00a840154a60bd394d960ee382ab with delete_type TABLET_DATA_DELETED (replaced by tablet 5dc5c4248379441595cc3e5f8c8690e4) from {username='slave'} at 127.0.0.1:47958
I20260502 14:01:00.886150 7548 tablet_service.cc:1558] Processing DeleteTablet for tablet 61a0294d54c941e98cbee66f5ac2c655 with delete_type TABLET_DATA_DELETED (replaced by tablet a1e9410673c743bdbe0b0a6cabdbbac3) from {username='slave'} at 127.0.0.1:47958
I20260502 14:01:00.886220 7553 tablet_service.cc:1558] Processing DeleteTablet for tablet 735a14bd06c1401a8e25e3a879048524 with delete_type TABLET_DATA_DELETED (replaced by tablet b67a5c0fd2ad49fc8a8f9550567de239) from {username='slave'} at 127.0.0.1:47958
I20260502 14:01:00.886320 7551 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee6e9e5b45444a883171cc483e8a4ca (DEFAULT_TABLE table=default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:00.886385 7549 tablet_service.cc:1558] Processing DeleteTablet for tablet 13128c34905046aeb1f2130a0beb5c5f with delete_type TABLET_DATA_DELETED (replaced by tablet 1ee6e9e5b45444a883171cc483e8a4ca) from {username='slave'} at 127.0.0.1:47958
I20260502 14:01:00.886440 7413 tablet_service.cc:1511] Processing CreateTablet for tablet 5dc5c4248379441595cc3e5f8c8690e4 (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:00.886438 7555 tablet_service.cc:1511] Processing CreateTablet for tablet 5dc5c4248379441595cc3e5f8c8690e4 (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:00.886597 7551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee6e9e5b45444a883171cc483e8a4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:00.886673 7413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc5c4248379441595cc3e5f8c8690e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:00.886732 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc5c4248379441595cc3e5f8c8690e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:00.886902 7552 tablet_service.cc:1511] Processing CreateTablet for tablet a1e9410673c743bdbe0b0a6cabdbbac3 (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:00.887089 7552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e9410673c743bdbe0b0a6cabdbbac3. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fa64cda2433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 14:01:00.889478 7410 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee6e9e5b45444a883171cc483e8a4ca (DEFAULT_TABLE table=default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:00.889755 7410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee6e9e5b45444a883171cc483e8a4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:00.889981 8407 tablet_replica.cc:333] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:00.890110 8407 raft_consensus.cc:2243] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:00.890352 8407 raft_consensus.cc:2272] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:00.890426 7274 tablet_service.cc:1558] Processing DeleteTablet for tablet b9cf00a840154a60bd394d960ee382ab with delete_type TABLET_DATA_DELETED (replaced by tablet 5dc5c4248379441595cc3e5f8c8690e4) from {username='slave'} at 127.0.0.1:52302
I20260502 14:01:00.890708 7277 tablet_service.cc:1558] Processing DeleteTablet for tablet 61a0294d54c941e98cbee66f5ac2c655 with delete_type TABLET_DATA_DELETED (replaced by tablet a1e9410673c743bdbe0b0a6cabdbbac3) from {username='slave'} at 127.0.0.1:52302
I20260502 14:01:00.890785 8407 ts_tablet_manager.cc:1916] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:00.890820 7276 tablet_service.cc:1558] Processing DeleteTablet for tablet 13128c34905046aeb1f2130a0beb5c5f with delete_type TABLET_DATA_DELETED (replaced by tablet 1ee6e9e5b45444a883171cc483e8a4ca) from {username='slave'} at 127.0.0.1:52302
I20260502 14:01:00.891110 7272 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee6e9e5b45444a883171cc483e8a4ca (DEFAULT_TABLE table=default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:00.891505 7272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee6e9e5b45444a883171cc483e8a4ca. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fa64cda134a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 14:01:00.894361 7269 tablet_service.cc:1511] Processing CreateTablet for tablet 5dc5c4248379441595cc3e5f8c8690e4 (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:00.894603 7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc5c4248379441595cc3e5f8c8690e4. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fa64cda0aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 14:01:00.891162 7275 tablet_service.cc:1558] Processing DeleteTablet for tablet 735a14bd06c1401a8e25e3a879048524 with delete_type TABLET_DATA_DELETED (replaced by tablet b67a5c0fd2ad49fc8a8f9550567de239) from {username='slave'} at 127.0.0.1:52302
I20260502 14:01:00.891110 7273 tablet_service.cc:1511] Processing CreateTablet for tablet a1e9410673c743bdbe0b0a6cabdbbac3 (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:00.896823 8409 tablet_replica.cc:333] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:00.896862 7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e9410673c743bdbe0b0a6cabdbbac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:00.897193 7551 tablet_service.cc:1511] Processing CreateTablet for tablet b67a5c0fd2ad49fc8a8f9550567de239 (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:00.897428 7551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67a5c0fd2ad49fc8a8f9550567de239. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fa64cda61b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260502 14:01:00.899487 8409 raft_consensus.cc:2243] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:00.899664 8409 raft_consensus.cc:2272] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x55570b572244 std::function<>::operator()() at ??:0
I20260502 14:01:00.900110 8409 ts_tablet_manager.cc:1916] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:00.900334 8407 ts_tablet_manager.cc:1929] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:00.900418 8407 log.cc:1199] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/61a0294d54c941e98cbee66f5ac2c655
I20260502 14:01:00.900683 8407 ts_tablet_manager.cc:1950] T 61a0294d54c941e98cbee66f5ac2c655 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:00.900859 7273 tablet_service.cc:1511] Processing CreateTablet for tablet b67a5c0fd2ad49fc8a8f9550567de239 (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:00.901090 7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67a5c0fd2ad49fc8a8f9550567de239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:00.901743 7410 tablet_service.cc:1511] Processing CreateTablet for tablet b67a5c0fd2ad49fc8a8f9550567de239 (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:00.901971 7410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67a5c0fd2ad49fc8a8f9550567de239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:00.902375 8408 tablet_bootstrap.cc:492] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
@ 0x7fa648d337ea kudu::Thread::SuperviseThread() at ??:0
I20260502 14:01:00.903463 8408 tablet_bootstrap.cc:654] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:00.903825 8301 catalog_manager.cc:5002] TS 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): tablet 61a0294d54c941e98cbee66f5ac2c655 (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]) successfully deleted
I20260502 14:01:00.904187 8411 tablet_replica.cc:333] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:00.904239 8410 tablet_bootstrap.cc:492] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:00.904263 8407 tablet_replica.cc:333] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:00.904316 8411 raft_consensus.cc:2243] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:00.904362 8407 raft_consensus.cc:2243] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:00.904436 8411 raft_consensus.cc:2272] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:00.904528 8407 raft_consensus.cc:2272] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:00.904808 8411 ts_tablet_manager.cc:1916] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:00.904889 8407 ts_tablet_manager.cc:1916] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:00.905263 8410 tablet_bootstrap.cc:654] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
@ 0x7fa6496776db start_thread at ??:0
I20260502 14:01:00.905476 8412 tablet_bootstrap.cc:492] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:00.906422 8412 tablet_bootstrap.cc:654] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:00.906473 8409 ts_tablet_manager.cc:1929] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:00.906538 8409 log.cc:1199] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/b9cf00a840154a60bd394d960ee382ab
I20260502 14:01:00.906791 8409 ts_tablet_manager.cc:1950] T b9cf00a840154a60bd394d960ee382ab P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:00.906872 8407 ts_tablet_manager.cc:1929] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:00.906934 8407 log.cc:1199] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/b9cf00a840154a60bd394d960ee382ab
@ 0x7fa6469e561f clone at ??:0
I20260502 14:01:00.907203 8407 ts_tablet_manager.cc:1950] T b9cf00a840154a60bd394d960ee382ab P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:00.907864 8410 tablet_bootstrap.cc:492] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:00.907984 8410 ts_tablet_manager.cc:1403] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 14:01:00.908576 8411 ts_tablet_manager.cc:1929] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:00.908649 8411 log.cc:1199] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/b9cf00a840154a60bd394d960ee382ab
I20260502 14:01:00.908877 8411 ts_tablet_manager.cc:1950] T b9cf00a840154a60bd394d960ee382ab P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:00.909067 8409 tablet_replica.cc:333] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:00.909277 8408 tablet_bootstrap.cc:492] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:00.909371 8408 ts_tablet_manager.cc:1403] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260502 14:01:00.909585 8410 raft_consensus.cc:359] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.909654 8411 tablet_replica.cc:333] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:00.909691 8410 raft_consensus.cc:385] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:00.909722 8410 raft_consensus.cc:740] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:00.909768 8411 raft_consensus.cc:2243] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:00.909860 8411 raft_consensus.cc:2272] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:00.909811 8408 raft_consensus.cc:359] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.909901 8408 raft_consensus.cc:385] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:00.909930 8408 raft_consensus.cc:740] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:00.910059 8408 consensus_queue.cc:260] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.910207 8411 ts_tablet_manager.cc:1916] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:00.910166 8407 tablet_replica.cc:333] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:00.911166 8409 raft_consensus.cc:2243] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:00.911279 8409 raft_consensus.cc:2272] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:00.911652 8409 ts_tablet_manager.cc:1916] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:00.910337 8408 ts_tablet_manager.cc:1434] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:00.912284 8407 raft_consensus.cc:2243] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:00.912411 8407 raft_consensus.cc:2272] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:00.912678 8410 consensus_queue.cc:260] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.912779 8407 ts_tablet_manager.cc:1916] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:00.913985 8409 ts_tablet_manager.cc:1929] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:00.914054 8409 log.cc:1199] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/61a0294d54c941e98cbee66f5ac2c655
I20260502 14:01:00.914295 8409 ts_tablet_manager.cc:1950] T 61a0294d54c941e98cbee66f5ac2c655 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:00.914558 8411 ts_tablet_manager.cc:1929] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:00.914629 8411 log.cc:1199] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/61a0294d54c941e98cbee66f5ac2c655
I20260502 14:01:00.914662 8408 tablet_bootstrap.cc:492] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:00.914856 8411 ts_tablet_manager.cc:1950] T 61a0294d54c941e98cbee66f5ac2c655 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:00.915097 8407 ts_tablet_manager.cc:1929] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:00.915169 8407 log.cc:1199] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/735a14bd06c1401a8e25e3a879048524
I20260502 14:01:00.915411 8407 ts_tablet_manager.cc:1950] T 735a14bd06c1401a8e25e3a879048524 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:00.915743 8410 ts_tablet_manager.cc:1434] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260502 14:01:00.915863 8408 tablet_bootstrap.cc:654] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:00.916023 8411 tablet_replica.cc:333] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:00.916025 8409 tablet_replica.cc:333] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:00.916132 8409 raft_consensus.cc:2243] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:00.916307 8409 raft_consensus.cc:2272] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:00.916669 8409 ts_tablet_manager.cc:1916] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:00.916923 8411 raft_consensus.cc:2243] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:00.917034 8411 raft_consensus.cc:2272] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:00.917377 8411 ts_tablet_manager.cc:1916] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:00.918238 8410 tablet_bootstrap.cc:492] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:00.918556 8409 ts_tablet_manager.cc:1929] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:00.918624 8409 log.cc:1199] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/735a14bd06c1401a8e25e3a879048524
I20260502 14:01:00.918826 8409 ts_tablet_manager.cc:1950] T 735a14bd06c1401a8e25e3a879048524 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:00.919413 8411 ts_tablet_manager.cc:1929] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:00.919481 8411 log.cc:1199] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/13128c34905046aeb1f2130a0beb5c5f
I20260502 14:01:00.919443 8410 tablet_bootstrap.cc:654] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:00.919698 8411 ts_tablet_manager.cc:1950] T 13128c34905046aeb1f2130a0beb5c5f P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:00.920260 8409 tablet_replica.cc:333] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:00.919685 8407 tablet_replica.cc:333] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:00.920526 8407 raft_consensus.cc:2243] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:00.920708 8407 raft_consensus.cc:2272] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:00.921068 8407 ts_tablet_manager.cc:1916] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:00.921658 8412 tablet_bootstrap.cc:492] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:00.921716 8411 tablet_replica.cc:333] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:00.921742 8412 ts_tablet_manager.cc:1403] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260502 14:01:00.921826 8411 raft_consensus.cc:2243] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:00.921922 8411 raft_consensus.cc:2272] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:00.922254 8411 ts_tablet_manager.cc:1916] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:00.923270 8407 ts_tablet_manager.cc:1929] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:00.923336 8407 log.cc:1199] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/13128c34905046aeb1f2130a0beb5c5f
I20260502 14:01:00.923556 8407 ts_tablet_manager.cc:1950] T 13128c34905046aeb1f2130a0beb5c5f P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:00.920871 8410 tablet_bootstrap.cc:492] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:00.923820 8410 ts_tablet_manager.cc:1403] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260502 14:01:00.923835 8412 raft_consensus.cc:359] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.924022 8412 raft_consensus.cc:385] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:00.924058 8412 raft_consensus.cc:740] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:00.924182 8412 consensus_queue.cc:260] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.924461 8412 ts_tablet_manager.cc:1434] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:00.924444 8410 raft_consensus.cc:359] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.924549 8410 raft_consensus.cc:385] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:00.924580 8410 raft_consensus.cc:740] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:00.924662 8412 tablet_bootstrap.cc:492] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:00.924726 8410 consensus_queue.cc:260] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.924996 8410 ts_tablet_manager.cc:1434] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:00.920382 8409 raft_consensus.cc:2243] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:00.925230 8410 tablet_bootstrap.cc:492] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:00.925287 8409 raft_consensus.cc:2272] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:00.925460 8411 ts_tablet_manager.cc:1929] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:00.925534 8411 log.cc:1199] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/735a14bd06c1401a8e25e3a879048524
I20260502 14:01:00.925678 8409 ts_tablet_manager.cc:1916] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:00.925918 8411 ts_tablet_manager.cc:1950] T 735a14bd06c1401a8e25e3a879048524 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:00.926120 8412 tablet_bootstrap.cc:654] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:00.926203 8410 tablet_bootstrap.cc:654] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:00.927874 8409 ts_tablet_manager.cc:1929] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:00.927974 8409 log.cc:1199] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/13128c34905046aeb1f2130a0beb5c5f
I20260502 14:01:00.928197 8409 ts_tablet_manager.cc:1950] T 13128c34905046aeb1f2130a0beb5c5f P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:00.930600 8408 tablet_bootstrap.cc:492] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:00.930748 8408 ts_tablet_manager.cc:1403] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260502 14:01:00.931311 8408 raft_consensus.cc:359] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.931440 8408 raft_consensus.cc:385] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:00.931478 8408 raft_consensus.cc:740] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:00.931623 8408 consensus_queue.cc:260] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.931674 8412 tablet_bootstrap.cc:492] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:00.931773 8412 ts_tablet_manager.cc:1403] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260502 14:01:00.932044 8408 ts_tablet_manager.cc:1434] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260502 14:01:00.932263 8408 tablet_bootstrap.cc:492] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:00.932286 8412 raft_consensus.cc:359] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.932404 8412 raft_consensus.cc:385] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:00.932439 8412 raft_consensus.cc:740] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:00.932600 8412 consensus_queue.cc:260] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.933895 8408 tablet_bootstrap.cc:654] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:00.934566 8412 ts_tablet_manager.cc:1434] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 14:01:00.936427 8412 tablet_bootstrap.cc:492] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:00.937577 8412 tablet_bootstrap.cc:654] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:00.938530 8410 tablet_bootstrap.cc:492] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:00.938629 8410 ts_tablet_manager.cc:1403] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260502 14:01:00.938655 8412 tablet_bootstrap.cc:492] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:00.938740 8412 ts_tablet_manager.cc:1403] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260502 14:01:00.939139 8410 raft_consensus.cc:359] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.939184 8412 raft_consensus.cc:359] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.939254 8410 raft_consensus.cc:385] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:00.939286 8410 raft_consensus.cc:740] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:00.939287 8412 raft_consensus.cc:385] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:00.939323 8412 raft_consensus.cc:740] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:00.939412 8410 consensus_queue.cc:260] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.939456 8412 consensus_queue.cc:260] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.939702 8410 ts_tablet_manager.cc:1434] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:00.939718 8412 ts_tablet_manager.cc:1434] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:00.939957 8410 tablet_bootstrap.cc:492] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:00.939953 8412 tablet_bootstrap.cc:492] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:00.940981 8412 tablet_bootstrap.cc:654] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:00.940982 8410 tablet_bootstrap.cc:654] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:00.942219 8410 tablet_bootstrap.cc:492] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:00.942293 8410 ts_tablet_manager.cc:1403] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260502 14:01:00.943010 8410 raft_consensus.cc:359] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.943120 8410 raft_consensus.cc:385] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:00.943153 8410 raft_consensus.cc:740] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:00.943289 8410 consensus_queue.cc:260] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.943686 8410 ts_tablet_manager.cc:1434] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:00.944404 8412 tablet_bootstrap.cc:492] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:00.944489 8412 ts_tablet_manager.cc:1403] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260502 14:01:00.944949 8412 raft_consensus.cc:359] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.945050 8412 raft_consensus.cc:385] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:00.945080 8412 raft_consensus.cc:740] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:00.945231 8412 consensus_queue.cc:260] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.945587 8412 ts_tablet_manager.cc:1434] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:00.945876 8408 tablet_bootstrap.cc:492] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:00.945987 8408 ts_tablet_manager.cc:1403] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260502 14:01:00.946596 8408 raft_consensus.cc:359] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.946717 8408 raft_consensus.cc:385] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:00.946748 8408 raft_consensus.cc:740] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:00.946870 8408 consensus_queue.cc:260] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.947244 8408 ts_tablet_manager.cc:1434] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:00.947528 8408 tablet_bootstrap.cc:492] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:00.948685 8408 tablet_bootstrap.cc:654] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:00.949905 8408 tablet_bootstrap.cc:492] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:00.949990 8408 ts_tablet_manager.cc:1403] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:00.950507 8408 raft_consensus.cc:359] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.950621 8408 raft_consensus.cc:385] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:00.950655 8408 raft_consensus.cc:740] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:00.950793 8408 consensus_queue.cc:260] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.951077 8408 ts_tablet_manager.cc:1434] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:00.982748 8380 raft_consensus.cc:493] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:00.982906 8380 raft_consensus.cc:515] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.983433 8380 leader_election.cc:290] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:00.984031 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e9e5b45444a883171cc483e8a4ca" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:00.984018 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e9e5b45444a883171cc483e8a4ca" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:00.984191 7297 raft_consensus.cc:2468] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:01:00.984187 7434 raft_consensus.cc:2468] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:01:00.984608 7511 leader_election.cc:304] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:00.984812 8380 raft_consensus.cc:2804] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:00.984905 8380 raft_consensus.cc:493] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:00.984952 8380 raft_consensus.cc:3060] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:00.986649 8380 raft_consensus.cc:515] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:00.987171 8380 leader_election.cc:290] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:00.987782 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e9e5b45444a883171cc483e8a4ca" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:01:00.987810 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e9e5b45444a883171cc483e8a4ca" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:00.987937 7297 raft_consensus.cc:3060] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:00.987967 7434 raft_consensus.cc:3060] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:00.988720 7297 raft_consensus.cc:2468] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:01:00.988919 7434 raft_consensus.cc:2468] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:01:00.989040 7508 leader_election.cc:304] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:00.989231 8380 raft_consensus.cc:2804] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:00.989507 8380 raft_consensus.cc:697] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:01:00.989881 8380 consensus_queue.cc:237] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:01.012511 8256 raft_consensus.cc:493] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:01.012729 8256 raft_consensus.cc:515] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:01.013217 8256 leader_election.cc:290] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:01.013746 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e9410673c743bdbe0b0a6cabdbbac3" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:01.013747 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e9410673c743bdbe0b0a6cabdbbac3" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:01:01.013895 7574 raft_consensus.cc:2468] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:01.013895 7434 raft_consensus.cc:2468] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:01.014199 7233 leader_election.cc:304] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:01:01.014361 8256 raft_consensus.cc:2804] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:01.014418 8256 raft_consensus.cc:493] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:01.014456 8256 raft_consensus.cc:3060] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:01.015550 8256 raft_consensus.cc:515] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:01.015882 8256 leader_election.cc:290] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:01.016356 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e9410673c743bdbe0b0a6cabdbbac3" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:01.016345 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e9410673c743bdbe0b0a6cabdbbac3" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:01:01.016474 7434 raft_consensus.cc:3060] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:01.016482 7574 raft_consensus.cc:3060] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:01.017186 7434 raft_consensus.cc:2468] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:01.017449 7574 raft_consensus.cc:2468] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:01.017490 7233 leader_election.cc:304] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:01:01.017699 8256 raft_consensus.cc:2804] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:01.017787 8256 raft_consensus.cc:697] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:01:01.017964 8256 consensus_queue.cc:237] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
W20260502 14:01:01.034725 7511 consensus_peers.cc:597] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4bb598ead00b4e199060f15d19eb9f9a. This is attempt 6: this message will repeat every 5th retry.
I20260502 14:01:01.085250 8380 raft_consensus.cc:493] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:01.085397 8380 raft_consensus.cc:515] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:01.086032 8380 leader_election.cc:290] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:01.086500 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc5c4248379441595cc3e5f8c8690e4" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:01.086532 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc5c4248379441595cc3e5f8c8690e4" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:01.086647 7434 raft_consensus.cc:2468] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:01:01.086683 7297 raft_consensus.cc:2468] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:01:01.086943 7511 leader_election.cc:304] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:01.087117 8380 raft_consensus.cc:2804] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:01.087168 8380 raft_consensus.cc:493] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:01.087214 8380 raft_consensus.cc:3060] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:01.088212 8380 raft_consensus.cc:515] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:01.088580 8380 leader_election.cc:290] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:01.088970 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc5c4248379441595cc3e5f8c8690e4" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:01.088970 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc5c4248379441595cc3e5f8c8690e4" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:01:01.089098 7297 raft_consensus.cc:3060] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:01.089148 7434 raft_consensus.cc:3060] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:01.090052 7297 raft_consensus.cc:2468] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:01:01.090052 7434 raft_consensus.cc:2468] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:01:01.090518 7508 leader_election.cc:304] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:01.090821 8380 raft_consensus.cc:2804] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:01.090901 8380 raft_consensus.cc:697] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:01:01.091049 8380 consensus_queue.cc:237] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:01.100801 8256 raft_consensus.cc:493] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:01.100970 8256 raft_consensus.cc:515] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:01.101410 8256 leader_election.cc:290] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:01.101898 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67a5c0fd2ad49fc8a8f9550567de239" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:01.101936 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67a5c0fd2ad49fc8a8f9550567de239" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:01:01.102056 7574 raft_consensus.cc:2468] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:01.102056 7434 raft_consensus.cc:2468] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:01.102336 7233 leader_election.cc:304] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:01.102514 8256 raft_consensus.cc:2804] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:01.102586 8256 raft_consensus.cc:493] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:01.102625 8256 raft_consensus.cc:3060] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:01.103658 8256 raft_consensus.cc:515] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:01.104039 8256 leader_election.cc:290] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:01.104477 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67a5c0fd2ad49fc8a8f9550567de239" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:01:01.104511 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67a5c0fd2ad49fc8a8f9550567de239" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:01.104609 7434 raft_consensus.cc:3060] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:01.104609 7574 raft_consensus.cc:3060] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
W20260502 14:01:01.104770 7508 connection.cc:570] server connection from 127.0.0.1:47958 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:01.104827 7369 connection.cc:570] server connection from 127.0.0.1:40832 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:01.105000 7232 connection.cc:570] server connection from 127.0.0.1:52302 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:01.105005 7511 connection.cc:570] client connection to 127.6.125.125:46147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260502 14:01:01.105556 7574 raft_consensus.cc:2468] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:01.105767 7434 raft_consensus.cc:2468] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:01.105942 7233 leader_election.cc:304] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:01.106137 8256 raft_consensus.cc:2804] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:01.106225 8256 raft_consensus.cc:697] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:01:01.106415 8256 consensus_queue.cc:237] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
W20260502 14:01:01.107194 7631 connection.cc:570] client connection to 127.6.125.125:46147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:01.107762 7631 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.6.125.125:46147)
W20260502 14:01:01.108124 7631 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.6.125.125:46147)
W20260502 14:01:01.108234 7631 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.6.125.125:46147)
W20260502 14:01:01.108307 7631 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.6.125.125:46147)
W20260502 14:01:01.109581 8376 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:01.105688 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.125:46147 (local address 127.6.125.67:52305)
0502 14:01:01.105862 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:01.105878 (+ 16us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:01.105960 (+ 82us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:01.109464 (+ 3504us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":86}
W20260502 14:01:01.109982 8365 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:01.107463 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.125:46147 (local address 127.6.125.65:40681)
0502 14:01:01.107740 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:01.107759 (+ 19us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:01.107830 (+ 71us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:01.109892 (+ 2062us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":206}
W20260502 14:01:01.110260 8062 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:01.109210 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.125:46147 (local address 127.0.0.1:44620)
0502 14:01:01.109350 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:01.109365 (+ 15us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:01.109444 (+ 79us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:01.110178 (+ 734us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":48}
W20260502 14:01:01.110637 8375 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:01.106195 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.125:46147 (local address 127.6.125.66:36987)
0502 14:01:01.106324 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:01.106338 (+ 14us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:01.106478 (+ 140us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:01.110529 (+ 4051us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":55}
I20260502 14:01:01.395705 8441 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:01.396006 8441 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:01.396934 8441 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:01.398597 8088 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:01.398732 8087 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:01.398802 8087 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:01.399065 8441 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260502 14:01:01.449004 8256 consensus_queue.cc:1048] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:01.453846 8447 consensus_queue.cc:1048] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:01.466617 8380 consensus_queue.cc:1048] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:01.470212 8436 consensus_queue.cc:1048] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:01.470446 8378 consensus_queue.cc:1048] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:01.476148 8436 consensus_queue.cc:1048] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:01.519147 8380 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:01.519304 8380 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:01:01.519873 8380 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:01.520663 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:01:01.520851 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:01:01.520944 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:01.521232 8380 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:01.549407 8447 consensus_queue.cc:1048] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:01.554677 8256 consensus_queue.cc:1048] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:01.666062 8067 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:01:01.666199 8067 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:01:01.942269 7508 consensus_peers.cc:597] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4bb598ead00b4e199060f15d19eb9f9a. This is attempt 6: this message will repeat every 5th retry.
I20260502 14:01:01.943662 8380 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:01.943806 8380 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:01.944281 8380 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:01.944926 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:01:01.945176 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:01:01.945250 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:01.945444 8380 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:01.995178 8464 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:01.995325 8464 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:01.995769 8464 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:01.997234 8087 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:01.997332 8088 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:01.997624 8088 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:01.997918 8464 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260502 14:01:02.791016 6645 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu with pid 8067
I20260502 14:01:02.860492 8436 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:02.860652 8436 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:02.861109 8436 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:02.862583 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:01:02.862717 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:01:02.862785 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:02.862934 8436 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:03.534807 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--webserver_interface=127.6.125.126
--webserver_port=39397
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 14:01:03.655750 8483 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:01:03.656050 8483 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:01:03.656122 8483 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:01:03.660140 8483 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 14:01:03.660229 8483 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:01:03.660257 8483 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 14:01:03.660282 8483 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 14:01:03.665143 8483 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.125.126
--webserver_port=39397
--never_fsync=true
--heap_profile_path=/tmp/kudu.8483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:01:03.666535 8483 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:01:03.668076 8483 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:01:03.675166 8489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:01:03.675107 8490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:01:03.675282 8483 server_base.cc:1061] running on GCE node
W20260502 14:01:03.675103 8492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:01:03.676162 8483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:01:03.677239 8483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:01:03.678442 8483 hybrid_clock.cc:648] HybridClock initialized: now 1777730463678415 us; error 41 us; skew 500 ppm
I20260502 14:01:03.681402 8483 webserver.cc:492] Webserver started at http://127.6.125.126:39397/ using document root <none> and password file <none>
I20260502 14:01:03.682065 8483 fs_manager.cc:362] Metadata directory not provided
I20260502 14:01:03.682138 8483 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:01:03.686964 8483 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260502 14:01:03.689590 8498 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:01:03.690781 8483 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260502 14:01:03.690929 8483 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
uuid: "9d590d630acd4892b59504b1c66c4f2d"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:01:03.691609 8483 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:01:03.708550 8483 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:01:03.709259 8483 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:01:03.709453 8483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:01:03.717442 8483 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.126:45121
I20260502 14:01:03.717501 8550 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.126:45121 every 8 connection(s)
I20260502 14:01:03.718920 8483 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
I20260502 14:01:03.722391 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 8483
I20260502 14:01:03.723852 8551 sys_catalog.cc:263] Verifying existing consensus state
I20260502 14:01:03.726181 8551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap starting.
I20260502 14:01:03.734607 7621 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:01:03.739185 8551 log.cc:826] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Log is configured to *not* fsync() on all Append() calls
I20260502 14:01:03.786696 8551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=90 overwritten=0 applied=90 ignored=0} inserts{seen=54 ignored=0} mutations{seen=75 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:01:03.787112 8551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap complete.
I20260502 14:01:03.790315 8551 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:03.790759 8551 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d590d630acd4892b59504b1c66c4f2d, State: Initialized, Role: FOLLOWER
I20260502 14:01:03.791345 8551 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 90, Last appended: 7.90, Last appended by leader: 90, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:03.792037 8556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:03.792163 8556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:03.792637 8551 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: configured and running, proceeding with master startup.
I20260502 14:01:03.799681 8570 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:03.799867 8570 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: loading cluster ID for follower catalog manager: success
I20260502 14:01:03.802729 8570 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: acquiring CA information for follower catalog manager: success
I20260502 14:01:03.805341 8570 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 14:01:03.805879 8483 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:01:03.807981 8483 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:04.067459 7481 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:01:04.069845 8515 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" instance_seqno: 1777730451385809) as {username='slave'} at 127.6.125.66:56523; Asking this server to re-register.
I20260502 14:01:04.070667 7481 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:04.072429 8515 ts_manager.cc:194] Registered new tserver with Master: 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:04.136067 7343 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:01:04.137110 8515 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" instance_seqno: 1777730451168368) as {username='slave'} at 127.6.125.65:34443; Asking this server to re-register.
I20260502 14:01:04.137578 7343 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:04.138787 8515 ts_manager.cc:194] Registered new tserver with Master: 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:04.149632 8515 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" instance_seqno: 1777730451630765) as {username='slave'} at 127.6.125.67:41261; Asking this server to re-register.
I20260502 14:01:04.150108 7621 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:04.151206 8515 ts_manager.cc:194] Registered new tserver with Master: c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:04.382898 8580 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:04.383107 8580 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:04.384364 8580 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:04.385056 8501 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:04.386055 8502 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:04.386173 8501 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:04.386358 8501 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:04.386742 8580 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260502 14:01:04.753242 8436 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:04.753448 8436 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:04.753906 8436 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:04.754453 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:01:04.754649 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:01:04.754729 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:04.754940 8436 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:04.920656 8436 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:04.920796 8436 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:04.921221 8436 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:04.921948 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:01:04.922055 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:01:04.922271 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:04.922456 8436 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:05.042026 8588 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:05.042163 8588 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:05.042716 8588 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:05.044308 8502 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:05.044415 8501 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:05.044516 8501 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:05.044706 8588 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260502 14:01:05.386559 7511 consensus_peers.cc:597] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4bb598ead00b4e199060f15d19eb9f9a. This is attempt 11: this message will repeat every 5th retry.
I20260502 14:01:06.037953 8603 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:06.038112 8603 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:06.038789 8603 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:06.040377 8502 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:06.040513 8501 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:06.040617 8501 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:06.040875 8603 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260502 14:01:06.097133 8463 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:06.097291 8463 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:01:06.097973 8463 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:06.098807 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:01:06.098909 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:01:06.099015 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:06.099330 8463 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:06.540535 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.124:43159
--webserver_interface=127.6.125.124
--webserver_port=45523
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 14:01:06.614912 7508 consensus_peers.cc:597] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4bb598ead00b4e199060f15d19eb9f9a. This is attempt 11: this message will repeat every 5th retry.
W20260502 14:01:06.672974 8612 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:01:06.673413 8612 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:01:06.673489 8612 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:01:06.677776 8612 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 14:01:06.677860 8612 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:01:06.677887 8612 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 14:01:06.677911 8612 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 14:01:06.682693 8612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.124:43159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.6.125.124
--webserver_port=45523
--never_fsync=true
--heap_profile_path=/tmp/kudu.8612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:01:06.683933 8612 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:01:06.685181 8612 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:01:06.691447 8623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:01:06.691466 8626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:01:06.691504 8612 server_base.cc:1061] running on GCE node
W20260502 14:01:06.691531 8624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:01:06.692680 8612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:01:06.694778 8612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:01:06.695983 8612 hybrid_clock.cc:648] HybridClock initialized: now 1777730466695945 us; error 56 us; skew 500 ppm
I20260502 14:01:06.698592 8612 webserver.cc:492] Webserver started at http://127.6.125.124:45523/ using document root <none> and password file <none>
I20260502 14:01:06.699208 8612 fs_manager.cc:362] Metadata directory not provided
I20260502 14:01:06.699286 8612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:01:06.703441 8612 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:06.706089 8632 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:01:06.707593 8612 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:06.707751 8612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/wal
uuid: "a5d257c30a994bfdb03242b10606426f"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:01:06.708307 8612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:01:06.740412 8612 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:01:06.741108 8612 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:01:06.741289 8612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:01:06.749282 8612 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.124:43159
I20260502 14:01:06.749279 8684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.124:43159 every 8 connection(s)
I20260502 14:01:06.750768 8612 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-2/data/info.pb
I20260502 14:01:06.754946 8685 sys_catalog.cc:263] Verifying existing consensus state
I20260502 14:01:06.756739 8685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Bootstrap starting.
I20260502 14:01:06.759150 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 8612
I20260502 14:01:06.770377 8685 log.cc:826] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Log is configured to *not* fsync() on all Append() calls
I20260502 14:01:06.811793 8685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Bootstrap replayed 1/1 log segments. Stats: ops{read=76 overwritten=0 applied=76 ignored=0} inserts{seen=46 ignored=0} mutations{seen=59 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:01:06.812480 8685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Bootstrap complete.
I20260502 14:01:06.815290 8685 raft_consensus.cc:359] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:06.815666 8685 raft_consensus.cc:740] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5d257c30a994bfdb03242b10606426f, State: Initialized, Role: FOLLOWER
I20260502 14:01:06.816110 8685 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 76, Last appended: 5.76, Last appended by leader: 76, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:06.816627 8689 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:06.816756 8689 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:06.817199 8685 sys_catalog.cc:565] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: configured and running, proceeding with master startup.
I20260502 14:01:06.824105 8703 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:06.824276 8703 catalog_manager.cc:1562] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: loading cluster ID for follower catalog manager: success
I20260502 14:01:06.829088 8703 catalog_manager.cc:1584] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: acquiring CA information for follower catalog manager: success
I20260502 14:01:06.830956 8703 catalog_manager.cc:1612] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 14:01:06.833640 8612 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:01:06.835287 8612 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:06.835683 7622 heartbeater.cc:344] Connected to a master server at 127.6.125.124:43159
I20260502 14:01:06.843474 8649 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" instance_seqno: 1777730451630765) as {username='slave'} at 127.6.125.67:42943; Asking this server to re-register.
I20260502 14:01:06.845243 7622 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:06.847393 8649 ts_manager.cc:194] Registered new tserver with Master: c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:07.074615 7482 heartbeater.cc:344] Connected to a master server at 127.6.125.124:43159
I20260502 14:01:07.074781 7482 heartbeater.cc:499] Master 127.6.125.124:43159 was elected leader, sending a full tablet report...
I20260502 14:01:07.076261 8649 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" instance_seqno: 1777730451385809) as {username='slave'} at 127.6.125.66:58885; Asking this server to re-register.
I20260502 14:01:07.076804 7482 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:07.077986 8649 ts_manager.cc:194] Registered new tserver with Master: 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:07.144990 7344 heartbeater.cc:344] Connected to a master server at 127.6.125.124:43159
I20260502 14:01:07.145256 7344 heartbeater.cc:499] Master 127.6.125.124:43159 was elected leader, sending a full tablet report...
I20260502 14:01:07.146770 8649 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" instance_seqno: 1777730451168368) as {username='slave'} at 127.6.125.65:58051; Asking this server to re-register.
I20260502 14:01:07.147377 7344 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:07.148600 8649 ts_manager.cc:194] Registered new tserver with Master: 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:07.197887 8715 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:07.198030 8715 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:07.198542 8715 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:07.199980 8502 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:07.202838 8659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d590d630acd4892b59504b1c66c4f2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 90 } } ignore_live_leader: false dest_uuid: "a5d257c30a994bfdb03242b10606426f" is_pre_election: true
I20260502 14:01:07.203155 8659 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d590d630acd4892b59504b1c66c4f2d in term 5.
I20260502 14:01:07.203707 8501 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d, a5d257c30a994bfdb03242b10606426f; no voters: 78b194cad3b9424395e9a403da13ba80
I20260502 14:01:07.203946 8715 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260502 14:01:07.204018 8715 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:07.204051 8715 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 7 FOLLOWER]: Advancing to term 8
I20260502 14:01:07.205802 8715 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:07.206238 8715 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 election: Requested vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:01:07.206918 8659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d590d630acd4892b59504b1c66c4f2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 90 } } ignore_live_leader: false dest_uuid: "a5d257c30a994bfdb03242b10606426f"
I20260502 14:01:07.207098 8659 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 5 FOLLOWER]: Advancing to term 8
W20260502 14:01:07.207554 8502 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:07.209261 8659 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d590d630acd4892b59504b1c66c4f2d in term 8.
I20260502 14:01:07.209765 8501 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d, a5d257c30a994bfdb03242b10606426f; no voters: 78b194cad3b9424395e9a403da13ba80
I20260502 14:01:07.210055 8715 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 8 FOLLOWER]: Leader election won for term 8
I20260502 14:01:07.210268 8715 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 8 LEADER]: Becoming Leader. State: Replica: 9d590d630acd4892b59504b1c66c4f2d, State: Running, Role: LEADER
I20260502 14:01:07.210727 8715 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 7.90, Last appended by leader: 90, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:07.212769 8719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d590d630acd4892b59504b1c66c4f2d. Latest consensus state: current_term: 8 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:07.212930 8719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: LEADER
I20260502 14:01:07.213255 8721 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 14:01:07.215299 8721 catalog_manager.cc:679] Loaded metadata for table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]
I20260502 14:01:07.215651 8721 catalog_manager.cc:679] Loaded metadata for table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]
I20260502 14:01:07.215934 8721 catalog_manager.cc:679] Loaded metadata for table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]
I20260502 14:01:07.216203 8721 catalog_manager.cc:679] Loaded metadata for table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]
I20260502 14:01:07.216661 8721 catalog_manager.cc:679] Loaded metadata for table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]
I20260502 14:01:07.216958 8721 catalog_manager.cc:679] Loaded metadata for table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]
I20260502 14:01:07.217295 8721 catalog_manager.cc:679] Loaded metadata for table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]
I20260502 14:01:07.217567 8721 catalog_manager.cc:679] Loaded metadata for table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]
I20260502 14:01:07.217803 8721 catalog_manager.cc:679] Loaded metadata for table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]
I20260502 14:01:07.217996 8721 catalog_manager.cc:679] Loaded metadata for table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]
I20260502 14:01:07.218168 8721 catalog_manager.cc:679] Loaded metadata for table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]
I20260502 14:01:07.218329 8721 catalog_manager.cc:679] Loaded metadata for table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]
I20260502 14:01:07.219978 8721 tablet_loader.cc:96] loaded metadata for tablet 1ee6e9e5b45444a883171cc483e8a4ca (table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968])
I20260502 14:01:07.220463 8721 tablet_loader.cc:96] loaded metadata for tablet 20b64fa709284798944325339eb67a0f (table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16])
I20260502 14:01:07.221066 8721 tablet_loader.cc:96] loaded metadata for tablet 282c00536e1e4a708c32917582038281 (table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f])
I20260502 14:01:07.221254 8721 tablet_loader.cc:96] loaded metadata for tablet 303cc2525a0d44029b77fbbbf9f12ae1 (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065])
I20260502 14:01:07.221874 8721 tablet_loader.cc:96] loaded metadata for tablet 54df03f280ce41fda1d06bb316aaa33c (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86])
I20260502 14:01:07.222052 8721 tablet_loader.cc:96] loaded metadata for tablet 5dc5c4248379441595cc3e5f8c8690e4 (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15])
I20260502 14:01:07.222455 8721 tablet_loader.cc:96] loaded metadata for tablet 69d1158bbc864a9998326d5f45fead94 (table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77])
I20260502 14:01:07.222997 8721 tablet_loader.cc:96] loaded metadata for tablet 8fa858fb3eb243808f40536c334420be (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e])
I20260502 14:01:07.223189 8721 tablet_loader.cc:96] loaded metadata for tablet 912c143ef13f42529ec28b08615db7dd (table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95])
I20260502 14:01:07.223356 8721 tablet_loader.cc:96] loaded metadata for tablet a1e9410673c743bdbe0b0a6cabdbbac3 (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a])
I20260502 14:01:07.223625 8721 tablet_loader.cc:96] loaded metadata for tablet b67a5c0fd2ad49fc8a8f9550567de239 (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3])
I20260502 14:01:07.224092 8721 tablet_loader.cc:96] loaded metadata for tablet ca22b8c0f0384693bb0399b1b3319b87 (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504])
I20260502 14:01:07.224586 8721 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 14:01:07.225242 8721 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:07.225289 8721 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 14:01:07.225972 8721 catalog_manager.cc:1514] Loading token signing keys...
I20260502 14:01:07.226701 8721 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Loaded TSK: 0
I20260502 14:01:07.227350 8721 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 14:01:07.227941 8721 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 14:01:07.228440 8721 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 16
I20260502 14:01:07.252297 7551 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bb598ead00b4e199060f15d19eb9f9a with delete_type TABLET_DATA_DELETED (replaced by tablet 61a0294d54c941e98cbee66f5ac2c655) from {username='slave'} at 127.0.0.1:54008
I20260502 14:01:07.252633 8723 tablet_replica.cc:333] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:07.252755 8723 raft_consensus.cc:2243] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:07.252943 8723 raft_consensus.cc:2272] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:07.253297 8723 ts_tablet_manager.cc:1916] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:07.255577 8723 ts_tablet_manager.cc:1929] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:07.255661 8723 log.cc:1199] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/4bb598ead00b4e199060f15d19eb9f9a
I20260502 14:01:07.255874 8723 ts_tablet_manager.cc:1950] T 4bb598ead00b4e199060f15d19eb9f9a P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:07.256968 8502 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet 4bb598ead00b4e199060f15d19eb9f9a (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]) successfully deleted
I20260502 14:01:07.294195 8515 master_service.cc:954] ReplaceTablet: received request to replace tablet 282c00536e1e4a708c32917582038281 from {username='slave'} at 127.0.0.1:43284
I20260502 14:01:07.294307 8513 master_service.cc:954] ReplaceTablet: received request to replace tablet 5dc5c4248379441595cc3e5f8c8690e4 from {username='slave'} at 127.0.0.1:43284
I20260502 14:01:07.294631 8511 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43284:
table { table_name: "default.Table_0d20cbe3e06443a39d25177f4abb4de7" } new_table_name: "default.Table_2ce27412960f42de9ef1fc0a234fae45" modify_external_catalogs: true
I20260502 14:01:07.294811 8509 master_service.cc:954] ReplaceTablet: received request to replace tablet ca22b8c0f0384693bb0399b1b3319b87 from {username='slave'} at 127.0.0.1:43284
I20260502 14:01:07.295133 8508 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43284:
name: "default.Table_116f97550c144f10bc14cc8c29c1d169"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:07.295565 8507 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43284:
table { table_name: "default.Table_d303c0450b934f2bb0f8ab01b92f2e67" } new_table_name: "default.Table_18b522eec8284015942366c63506ec7e" modify_external_catalogs: true
I20260502 14:01:07.296005 8512 master_service.cc:954] ReplaceTablet: received request to replace tablet 8fa858fb3eb243808f40536c334420be from {username='slave'} at 127.0.0.1:43284
I20260502 14:01:07.296046 8506 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43284:
table { table_name: "default.Table_0912854d0fb44cf69bf731fbb257be24" } modify_external_catalogs: true
I20260502 14:01:07.296146 8506 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43284:
table { table_name: "default.Table_0912854d0fb44cf69bf731fbb257be24" } modify_external_catalogs: true
I20260502 14:01:07.296341 8510 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43284:
table { table_name: "default.Table_2866c4520a3d40c4b3c6ca93424e5a0b" } modify_external_catalogs: true
I20260502 14:01:07.296437 8510 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43284:
table { table_name: "default.Table_2866c4520a3d40c4b3c6ca93424e5a0b" } modify_external_catalogs: true
I20260502 14:01:07.294139 8514 master_service.cc:954] ReplaceTablet: received request to replace tablet 5dc5c4248379441595cc3e5f8c8690e4 from {username='slave'} at 127.0.0.1:43284
W20260502 14:01:07.299151 8502 consensus_peers.cc:597] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d -> Peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Couldn't send request to peer 78b194cad3b9424395e9a403da13ba80. Status: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260502 14:01:07.299181 8659 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Refusing update from remote peer 9d590d630acd4892b59504b1c66c4f2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 76. Preceding OpId from leader: term: 8 index: 92. (index mismatch)
I20260502 14:01:07.299863 8719 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 76, Time since last communication: 0.000s
F20260502 14:01:07.302076 8569 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 19, previous 19; dumping first 4 out of 10 received events: NotificationEvent(eventId=17, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_5bbf52ba925f45dfae2bee0f411a0316, message={"server":"","servicePrincipal":"","db":"default","table":"table_5bbf52ba925f45dfae2bee0f411a0316","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5bbf52ba925f45dfae2bee0f411a0316\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_5bbf52ba925f45dfae2bee0f411a0316\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5bbf52ba925f45dfae2bee0f411a0316\",\"kudu.table_id\":\"2e0834670d044a0fbe32ffcd671a778b\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=18, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_916010ddd67a42689b76591a02784a0a, message={"server":"","servicePrincipal":"","db":"default","table":"table_916010ddd67a42689b76591a02784a0a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_916010ddd67a42689b76591a02784a0a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_916010ddd67a42689b76591a02784a0a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_916010ddd67a42689b76591a02784a0a\",\"kudu.table_id\":\"337d1a2589374574b8d3b1735b5efe95\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_79e5262b7980424fbe659116c4785e9c, message={"server":"","servicePrincipal":"","db":"default","table":"table_79e5262b7980424fbe659116c4785e9c","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79e5262b7980424fbe659116c4785e9c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730452},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_79e5262b7980424fbe659116c4785e9c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79e5262b7980424fbe659116c4785e9c\",\"kudu.table_id\":\"2b961b00f8804350ade31c5ac13105e3\",\"transient_lastDdlTime\":\"1777730452\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_2866c4520a3d40c4b3c6ca93424e5a0b, message={"server":"","servicePrincipal":"","db":"default","table":"table_2866c4520a3d40c4b3c6ca93424e5a0b","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730453},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2866c4520a3d40c4b3c6ca93424e5a0b\",\"kudu.table_id\":\"a6606215bcc24f789f81868248dcd065\",\"transient_lastDdlTime\":\"1777730453\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7fc0be50adcd google::LogMessage::Fail() at ??:0
@ 0x7fc0be50eb93 google::LogMessage::SendToLog() at ??:0
@ 0x7fc0be50a7cc google::LogMessage::Flush() at ??:0
I20260502 14:01:07.308959 8689 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d590d630acd4892b59504b1c66c4f2d. Latest consensus state: current_term: 8 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:07.309108 8689 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:07.309206 8689 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:07.309275 8689 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:07.309448 8727 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:07.309511 8727 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fc0be50aa11 google::LogMessage::~LogMessage() at ??:0
I20260502 14:01:07.312515 8719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:07.312695 8719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: LEADER
I20260502 14:01:07.313717 8729 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:07.313835 8729 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:07.314495 8513 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Sending DeleteTablet for 3 replicas of tablet 5dc5c4248379441595cc3e5f8c8690e4
I20260502 14:01:07.314910 8514 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43284:
name: "default.Table_afe9c083ff0b4d1487651533fee05e6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:07.315164 8513 catalog_manager.cc:6741] ReplaceTablet: tablet 5dc5c4248379441595cc3e5f8c8690e4 deleted and replaced by tablet 36b15154f3cc4285a4d119da277c811d
I20260502 14:01:07.315375 8513 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43284:
name: "default.Table_c3fa81d759a04db897e93aa688729318"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:07.317427 8725 mvcc.cc:204] Tried to move back new op lower bound from 7281583994053849088 to 7281583950341185536. Current Snapshot: MvccSnapshot[applied={T|T < 7281583967804100608}]
@ 0x7fc0c3a7e433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 14:01:07.319200 7551 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dc5c4248379441595cc3e5f8c8690e4 with delete_type TABLET_DATA_DELETED (replaced by tablet 36b15154f3cc4285a4d119da277c811d) from {username='slave'} at 127.0.0.1:54008
I20260502 14:01:07.319404 8723 tablet_replica.cc:333] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:07.319540 8723 raft_consensus.cc:2243] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:07.319752 8723 raft_consensus.cc:2272] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:07.320199 8723 ts_tablet_manager.cc:1916] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:07.320982 8515 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Sending DeleteTablet for 3 replicas of tablet 282c00536e1e4a708c32917582038281
I20260502 14:01:07.321264 8515 catalog_manager.cc:6741] ReplaceTablet: tablet 282c00536e1e4a708c32917582038281 deleted and replaced by tablet 8b48d38bb19c4730b02922ca28e0c9ff
I20260502 14:01:07.321486 8515 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43284:
name: "default.Table_3803b7a44d4847adabbc5a04821f0382"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7fc0c3a7d34a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 14:01:07.322974 8509 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Sending DeleteTablet for 3 replicas of tablet ca22b8c0f0384693bb0399b1b3319b87
I20260502 14:01:07.323266 8509 catalog_manager.cc:6741] ReplaceTablet: tablet ca22b8c0f0384693bb0399b1b3319b87 deleted and replaced by tablet 634a57f067a84d7194cc4d1ecd4cbf1d
I20260502 14:01:07.323220 8723 ts_tablet_manager.cc:1929] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:07.323333 8723 log.cc:1199] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/5dc5c4248379441595cc3e5f8c8690e4
I20260502 14:01:07.323457 8509 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43284:
table { table_name: "default.Table_e209f5be8519489e973e7a888ad911ee" } modify_external_catalogs: true
I20260502 14:01:07.323585 8723 ts_tablet_manager.cc:1950] T 5dc5c4248379441595cc3e5f8c8690e4 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:07.323570 8509 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43284:
table { table_name: "default.Table_e209f5be8519489e973e7a888ad911ee" } modify_external_catalogs: true
I20260502 14:01:07.323711 7551 tablet_service.cc:1558] Processing DeleteTablet for tablet 282c00536e1e4a708c32917582038281 with delete_type TABLET_DATA_DELETED (replaced by tablet 8b48d38bb19c4730b02922ca28e0c9ff) from {username='slave'} at 127.0.0.1:54008
I20260502 14:01:07.324122 7551 tablet_service.cc:1558] Processing DeleteTablet for tablet ca22b8c0f0384693bb0399b1b3319b87 with delete_type TABLET_DATA_DELETED (replaced by tablet 634a57f067a84d7194cc4d1ecd4cbf1d) from {username='slave'} at 127.0.0.1:54008
I20260502 14:01:07.324270 8723 tablet_replica.cc:333] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:07.324389 8723 raft_consensus.cc:2243] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:07.324492 8723 raft_consensus.cc:2272] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:07.324857 8723 ts_tablet_manager.cc:1916] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:07.325372 8512 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Sending DeleteTablet for 3 replicas of tablet 8fa858fb3eb243808f40536c334420be
I20260502 14:01:07.325397 8502 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet 5dc5c4248379441595cc3e5f8c8690e4 (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]) successfully deleted
I20260502 14:01:07.325650 8512 catalog_manager.cc:6741] ReplaceTablet: tablet 8fa858fb3eb243808f40536c334420be deleted and replaced by tablet 531a069eeba64024abd6954b7819c916
I20260502 14:01:07.325802 7273 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dc5c4248379441595cc3e5f8c8690e4 with delete_type TABLET_DATA_DELETED (replaced by tablet 36b15154f3cc4285a4d119da277c811d) from {username='slave'} at 127.0.0.1:33730
I20260502 14:01:07.325862 8512 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43284:
name: "default.Table_4534fe13c1d94c399d9c725c85deb6d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:07.326032 7275 tablet_service.cc:1558] Processing DeleteTablet for tablet 282c00536e1e4a708c32917582038281 with delete_type TABLET_DATA_DELETED (replaced by tablet 8b48d38bb19c4730b02922ca28e0c9ff) from {username='slave'} at 127.0.0.1:33730
I20260502 14:01:07.326146 7269 tablet_service.cc:1558] Processing DeleteTablet for tablet ca22b8c0f0384693bb0399b1b3319b87 with delete_type TABLET_DATA_DELETED (replaced by tablet 634a57f067a84d7194cc4d1ecd4cbf1d) from {username='slave'} at 127.0.0.1:33730
I20260502 14:01:07.326383 7551 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa858fb3eb243808f40536c334420be with delete_type TABLET_DATA_DELETED (replaced by tablet 531a069eeba64024abd6954b7819c916) from {username='slave'} at 127.0.0.1:54008
I20260502 14:01:07.327733 8723 ts_tablet_manager.cc:1929] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:07.327795 8723 log.cc:1199] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/282c00536e1e4a708c32917582038281
I20260502 14:01:07.328037 8723 ts_tablet_manager.cc:1950] T 282c00536e1e4a708c32917582038281 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:07.328171 7269 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa858fb3eb243808f40536c334420be with delete_type TABLET_DATA_DELETED (replaced by tablet 531a069eeba64024abd6954b7819c916) from {username='slave'} at 127.0.0.1:33730
I20260502 14:01:07.328542 7275 tablet_service.cc:1511] Processing CreateTablet for tablet 36b15154f3cc4285a4d119da277c811d (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:07.328807 7275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b15154f3cc4285a4d119da277c811d. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fc0c3a7caad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 14:01:07.331432 8741 tablet_replica.cc:333] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:07.331568 8741 raft_consensus.cc:2243] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:07.331672 8741 raft_consensus.cc:2272] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:07.331822 7410 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dc5c4248379441595cc3e5f8c8690e4 with delete_type TABLET_DATA_DELETED (replaced by tablet 36b15154f3cc4285a4d119da277c811d) from {username='slave'} at 127.0.0.1:36730
I20260502 14:01:07.332068 7413 tablet_service.cc:1558] Processing DeleteTablet for tablet 282c00536e1e4a708c32917582038281 with delete_type TABLET_DATA_DELETED (replaced by tablet 8b48d38bb19c4730b02922ca28e0c9ff) from {username='slave'} at 127.0.0.1:36730
I20260502 14:01:07.332195 7414 tablet_service.cc:1558] Processing DeleteTablet for tablet ca22b8c0f0384693bb0399b1b3319b87 with delete_type TABLET_DATA_DELETED (replaced by tablet 634a57f067a84d7194cc4d1ecd4cbf1d) from {username='slave'} at 127.0.0.1:36730
I20260502 14:01:07.332340 7409 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa858fb3eb243808f40536c334420be with delete_type TABLET_DATA_DELETED (replaced by tablet 531a069eeba64024abd6954b7819c916) from {username='slave'} at 127.0.0.1:36730
I20260502 14:01:07.332626 7412 tablet_service.cc:1511] Processing CreateTablet for tablet 36b15154f3cc4285a4d119da277c811d (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:07.332875 7412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b15154f3cc4285a4d119da277c811d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:07.333801 8741 ts_tablet_manager.cc:1916] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:07.334559 7409 tablet_service.cc:1511] Processing CreateTablet for tablet 8b48d38bb19c4730b02922ca28e0c9ff (DEFAULT_TABLE table=default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:07.334787 7409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b48d38bb19c4730b02922ca28e0c9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:07.335512 7275 tablet_service.cc:1511] Processing CreateTablet for tablet 8b48d38bb19c4730b02922ca28e0c9ff (DEFAULT_TABLE table=default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:07.335564 7551 tablet_service.cc:1511] Processing CreateTablet for tablet 36b15154f3cc4285a4d119da277c811d (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:07.335737 7275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b48d38bb19c4730b02922ca28e0c9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:07.335821 7551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b15154f3cc4285a4d119da277c811d. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fc0c3a821b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260502 14:01:07.336818 8723 tablet_replica.cc:333] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:07.337101 7269 tablet_service.cc:1511] Processing CreateTablet for tablet 634a57f067a84d7194cc4d1ecd4cbf1d (DEFAULT_TABLE table=default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:07.337291 8502 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet 282c00536e1e4a708c32917582038281 (table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]) successfully deleted
I20260502 14:01:07.337432 7273 tablet_service.cc:1511] Processing CreateTablet for tablet 531a069eeba64024abd6954b7819c916 (DEFAULT_TABLE table=default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x5591d39d2244 std::function<>::operator()() at ??:0
I20260502 14:01:07.337636 8723 raft_consensus.cc:2243] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:07.337812 8723 raft_consensus.cc:2272] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:07.338186 8723 ts_tablet_manager.cc:1916] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:07.338244 7551 tablet_service.cc:1511] Processing CreateTablet for tablet 531a069eeba64024abd6954b7819c916 (DEFAULT_TABLE table=default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:07.338398 7555 tablet_service.cc:1511] Processing CreateTablet for tablet 634a57f067a84d7194cc4d1ecd4cbf1d (DEFAULT_TABLE table=default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:07.338265 7552 tablet_service.cc:1511] Processing CreateTablet for tablet 8b48d38bb19c4730b02922ca28e0c9ff (DEFAULT_TABLE table=default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:07.338666 7551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 531a069eeba64024abd6954b7819c916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:07.338845 7552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b48d38bb19c4730b02922ca28e0c9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:07.340485 8723 ts_tablet_manager.cc:1929] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 14:01:07.340552 8723 log.cc:1199] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/ca22b8c0f0384693bb0399b1b3319b87
I20260502 14:01:07.340655 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634a57f067a84d7194cc4d1ecd4cbf1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:07.340797 8723 ts_tablet_manager.cc:1950] T ca22b8c0f0384693bb0399b1b3319b87 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
@ 0x7fc0bfa0f7ea kudu::Thread::SuperviseThread() at ??:0
I20260502 14:01:07.341122 7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634a57f067a84d7194cc4d1ecd4cbf1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:07.341589 7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 531a069eeba64024abd6954b7819c916. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fc0c03536db start_thread at ??:0
I20260502 14:01:07.343398 7409 tablet_service.cc:1511] Processing CreateTablet for tablet 634a57f067a84d7194cc4d1ecd4cbf1d (DEFAULT_TABLE table=default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:07.343673 7409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634a57f067a84d7194cc4d1ecd4cbf1d. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fc0bd6c161f clone at ??:0
I20260502 14:01:07.344636 8502 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet ca22b8c0f0384693bb0399b1b3319b87 (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]) successfully deleted
I20260502 14:01:07.345103 8741 ts_tablet_manager.cc:1929] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:07.345158 8745 tablet_bootstrap.cc:492] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:07.345175 8741 log.cc:1199] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/5dc5c4248379441595cc3e5f8c8690e4
I20260502 14:01:07.345261 8743 tablet_replica.cc:333] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:07.345373 8743 raft_consensus.cc:2243] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:07.345446 8741 ts_tablet_manager.cc:1950] T 5dc5c4248379441595cc3e5f8c8690e4 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:07.345430 7412 tablet_service.cc:1511] Processing CreateTablet for tablet 531a069eeba64024abd6954b7819c916 (DEFAULT_TABLE table=default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:07.345633 8723 tablet_replica.cc:333] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:07.345764 8723 raft_consensus.cc:2243] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:07.345871 8723 raft_consensus.cc:2272] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:07.346033 8741 tablet_replica.cc:333] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:07.346143 8741 raft_consensus.cc:2243] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:07.346231 8723 ts_tablet_manager.cc:1916] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:07.346266 8745 tablet_bootstrap.cc:654] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:07.346338 8741 raft_consensus.cc:2272] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:07.346674 8741 ts_tablet_manager.cc:1916] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:07.346891 7412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 531a069eeba64024abd6954b7819c916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:07.348109 8742 tablet_bootstrap.cc:492] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:07.348238 8723 ts_tablet_manager.cc:1929] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 14:01:07.348300 8723 log.cc:1199] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/8fa858fb3eb243808f40536c334420be
I20260502 14:01:07.348524 8723 ts_tablet_manager.cc:1950] T 8fa858fb3eb243808f40536c334420be P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:07.348800 8741 ts_tablet_manager.cc:1929] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:07.348858 8741 log.cc:1199] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/282c00536e1e4a708c32917582038281
I20260502 14:01:07.349092 8741 ts_tablet_manager.cc:1950] T 282c00536e1e4a708c32917582038281 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:07.349161 8742 tablet_bootstrap.cc:654] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:07.349892 8745 tablet_bootstrap.cc:492] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:07.349969 8741 tablet_replica.cc:333] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:07.349982 8745 ts_tablet_manager.cc:1403] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260502 14:01:07.350008 8746 tablet_bootstrap.cc:492] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:07.350097 8741 raft_consensus.cc:2243] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:07.350214 8741 raft_consensus.cc:2272] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:07.350543 8741 ts_tablet_manager.cc:1916] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:07.350515 8745 raft_consensus.cc:359] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.350623 8745 raft_consensus.cc:385] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:07.350652 8745 raft_consensus.cc:740] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:07.350821 8745 consensus_queue.cc:260] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.351028 8746 tablet_bootstrap.cc:654] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:07.351169 8742 tablet_bootstrap.cc:492] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:07.351243 8742 ts_tablet_manager.cc:1403] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:07.351699 8742 raft_consensus.cc:359] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.351791 8742 raft_consensus.cc:385] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:07.351796 8745 ts_tablet_manager.cc:1434] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 14:01:07.351820 8742 raft_consensus.cc:740] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:07.351979 8745 tablet_bootstrap.cc:492] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:07.351976 8742 consensus_queue.cc:260] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.352221 8742 ts_tablet_manager.cc:1434] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:07.352414 8742 tablet_bootstrap.cc:492] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:07.352695 8741 ts_tablet_manager.cc:1929] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 14:01:07.352748 8741 log.cc:1199] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/ca22b8c0f0384693bb0399b1b3319b87
I20260502 14:01:07.352979 8741 ts_tablet_manager.cc:1950] T ca22b8c0f0384693bb0399b1b3319b87 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:07.345486 8743 raft_consensus.cc:2272] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:07.353088 8745 tablet_bootstrap.cc:654] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:07.353332 8742 tablet_bootstrap.cc:654] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:07.354332 8741 tablet_replica.cc:333] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:07.354436 8741 raft_consensus.cc:2243] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:07.354460 8746 tablet_bootstrap.cc:492] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:07.354530 8741 raft_consensus.cc:2272] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:07.354562 8746 ts_tablet_manager.cc:1403] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260502 14:01:07.354883 8741 ts_tablet_manager.cc:1916] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:07.355012 8746 raft_consensus.cc:359] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.355113 8746 raft_consensus.cc:385] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:07.355140 8746 raft_consensus.cc:740] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:07.355250 8746 consensus_queue.cc:260] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.355522 8746 ts_tablet_manager.cc:1434] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:07.355675 7621 heartbeater.cc:499] Master 127.6.125.126:45121 was elected leader, sending a full tablet report...
I20260502 14:01:07.356578 8746 tablet_bootstrap.cc:492] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:07.357532 8746 tablet_bootstrap.cc:654] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:07.358671 8746 tablet_bootstrap.cc:492] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:07.358709 8743 ts_tablet_manager.cc:1916] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:07.358745 8746 ts_tablet_manager.cc:1403] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260502 14:01:07.359210 8746 raft_consensus.cc:359] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.359309 8746 raft_consensus.cc:385] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:07.359350 8746 raft_consensus.cc:740] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:07.359474 8746 consensus_queue.cc:260] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.359757 8746 ts_tablet_manager.cc:1434] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:07.359961 8746 tablet_bootstrap.cc:492] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:07.360884 8743 ts_tablet_manager.cc:1929] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:07.360939 8743 log.cc:1199] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/5dc5c4248379441595cc3e5f8c8690e4
I20260502 14:01:07.361068 8746 tablet_bootstrap.cc:654] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:07.361137 8743 ts_tablet_manager.cc:1950] T 5dc5c4248379441595cc3e5f8c8690e4 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:07.362659 8746 tablet_bootstrap.cc:492] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:07.362699 8741 ts_tablet_manager.cc:1929] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 14:01:07.362751 8746 ts_tablet_manager.cc:1403] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:07.362766 8741 log.cc:1199] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/8fa858fb3eb243808f40536c334420be
I20260502 14:01:07.362999 8741 ts_tablet_manager.cc:1950] T 8fa858fb3eb243808f40536c334420be P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:07.363236 8746 raft_consensus.cc:359] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.363457 8746 raft_consensus.cc:385] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:07.363507 8746 raft_consensus.cc:740] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:07.363989 8746 consensus_queue.cc:260] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.364481 8746 ts_tablet_manager.cc:1434] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 14:01:07.364727 8746 tablet_bootstrap.cc:492] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:07.365947 8746 tablet_bootstrap.cc:654] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:07.366071 8743 tablet_replica.cc:333] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:07.366240 8743 raft_consensus.cc:2243] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:07.366360 8743 raft_consensus.cc:2272] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:07.366813 8743 ts_tablet_manager.cc:1916] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:07.367184 8746 tablet_bootstrap.cc:492] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:07.367264 8746 ts_tablet_manager.cc:1403] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:07.367769 8746 raft_consensus.cc:359] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.367878 8746 raft_consensus.cc:385] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:07.367974 8746 raft_consensus.cc:740] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:07.368117 8746 consensus_queue.cc:260] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.368436 8746 ts_tablet_manager.cc:1434] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 14:01:07.369300 8742 tablet_bootstrap.cc:492] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:07.369408 8742 ts_tablet_manager.cc:1403] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20260502 14:01:07.370007 8742 raft_consensus.cc:359] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.370121 8742 raft_consensus.cc:385] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:07.370153 8742 raft_consensus.cc:740] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:07.370290 8742 consensus_queue.cc:260] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.370609 8742 ts_tablet_manager.cc:1434] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260502 14:01:07.370698 8743 ts_tablet_manager.cc:1929] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:07.370771 8743 log.cc:1199] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/282c00536e1e4a708c32917582038281
I20260502 14:01:07.370831 8742 tablet_bootstrap.cc:492] T 531a069eeba64024abd6954b7819c916 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:07.371042 8743 ts_tablet_manager.cc:1950] T 282c00536e1e4a708c32917582038281 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:07.372231 8742 tablet_bootstrap.cc:654] T 531a069eeba64024abd6954b7819c916 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:07.373068 8743 tablet_replica.cc:333] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:07.373203 8743 raft_consensus.cc:2243] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:07.373389 8743 raft_consensus.cc:2272] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:07.373828 8742 tablet_bootstrap.cc:492] T 531a069eeba64024abd6954b7819c916 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:07.373903 8742 ts_tablet_manager.cc:1403] T 531a069eeba64024abd6954b7819c916 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:07.374349 8742 raft_consensus.cc:359] T 531a069eeba64024abd6954b7819c916 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.374449 8742 raft_consensus.cc:385] T 531a069eeba64024abd6954b7819c916 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:07.374481 8742 raft_consensus.cc:740] T 531a069eeba64024abd6954b7819c916 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:07.374589 8742 consensus_queue.cc:260] T 531a069eeba64024abd6954b7819c916 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.374737 8382 raft_consensus.cc:493] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:07.374800 8382 raft_consensus.cc:515] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.374977 8742 ts_tablet_manager.cc:1434] T 531a069eeba64024abd6954b7819c916 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:07.375138 8382 leader_election.cc:290] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:07.375160 8742 tablet_bootstrap.cc:492] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:07.375708 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b15154f3cc4285a4d119da277c811d" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:01:07.375838 7574 raft_consensus.cc:2468] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:07.376058 8743 ts_tablet_manager.cc:1916] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:07.376358 7233 leader_election.cc:304] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:07.376453 8742 tablet_bootstrap.cc:654] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:07.376514 8382 raft_consensus.cc:2804] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:07.376560 8382 raft_consensus.cc:493] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:07.376595 8382 raft_consensus.cc:3060] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:07.377200 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b15154f3cc4285a4d119da277c811d" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:07.377241 8745 tablet_bootstrap.cc:492] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:07.377357 8745 ts_tablet_manager.cc:1403] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20260502 14:01:07.377382 7434 raft_consensus.cc:2468] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:07.377688 8382 raft_consensus.cc:515] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.378026 8382 leader_election.cc:290] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:07.377976 8745 raft_consensus.cc:359] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.378086 8745 raft_consensus.cc:385] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:07.378120 8745 raft_consensus.cc:740] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:07.378386 8745 consensus_queue.cc:260] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.379141 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b15154f3cc4285a4d119da277c811d" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:01:07.379166 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b15154f3cc4285a4d119da277c811d" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:07.379312 7434 raft_consensus.cc:3060] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:07.380167 8745 ts_tablet_manager.cc:1434] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:07.380970 7434 raft_consensus.cc:2468] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:07.381385 8745 tablet_bootstrap.cc:492] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:07.381605 7233 leader_election.cc:304] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:01:07.381831 8382 raft_consensus.cc:2804] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:07.381914 8382 raft_consensus.cc:697] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:01:07.382123 8382 consensus_queue.cc:237] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.382416 8745 tablet_bootstrap.cc:654] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:07.382753 7574 raft_consensus.cc:3060] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:07.384132 7574 raft_consensus.cc:2468] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:07.385010 8743 ts_tablet_manager.cc:1929] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 14:01:07.385099 8743 log.cc:1199] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/ca22b8c0f0384693bb0399b1b3319b87
I20260502 14:01:07.385685 8743 ts_tablet_manager.cc:1950] T ca22b8c0f0384693bb0399b1b3319b87 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:07.386137 8745 tablet_bootstrap.cc:492] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:07.386235 8745 ts_tablet_manager.cc:1403] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260502 14:01:07.386531 8743 tablet_replica.cc:333] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:07.386654 8743 raft_consensus.cc:2243] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:07.386720 8745 raft_consensus.cc:359] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.386819 8743 raft_consensus.cc:2272] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:07.386848 8745 raft_consensus.cc:385] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:07.386879 8745 raft_consensus.cc:740] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:07.387174 8743 ts_tablet_manager.cc:1916] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:07.387501 8742 tablet_bootstrap.cc:492] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:07.387590 8742 ts_tablet_manager.cc:1403] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260502 14:01:07.387012 8745 consensus_queue.cc:260] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.388545 8745 ts_tablet_manager.cc:1434] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 14:01:07.388820 8463 raft_consensus.cc:493] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:07.394469 8463 raft_consensus.cc:515] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.388118 8742 raft_consensus.cc:359] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.394707 8742 raft_consensus.cc:385] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:07.394764 8742 raft_consensus.cc:740] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:07.394903 8463 leader_election.cc:290] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:07.394902 8742 consensus_queue.cc:260] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.395211 8742 ts_tablet_manager.cc:1434] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260502 14:01:07.395364 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531a069eeba64024abd6954b7819c916" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:07.395468 7297 raft_consensus.cc:2468] T 531a069eeba64024abd6954b7819c916 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:01:07.400214 7508 leader_election.cc:304] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:07.400475 8463 raft_consensus.cc:2804] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:07.400578 8463 raft_consensus.cc:493] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:07.400619 8463 raft_consensus.cc:3060] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:07.401755 8463 raft_consensus.cc:515] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.389195 8745 tablet_bootstrap.cc:492] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:07.411283 8463 leader_election.cc:290] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:07.411767 7433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531a069eeba64024abd6954b7819c916" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:07.390868 8743 ts_tablet_manager.cc:1929] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 14:01:07.412235 8743 log.cc:1199] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/8fa858fb3eb243808f40536c334420be
W20260502 14:01:07.412177 7511 leader_election.cc:343] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Illegal state: must be running to vote when last-logged opid is not known
I20260502 14:01:07.412544 8743 ts_tablet_manager.cc:1950] T 8fa858fb3eb243808f40536c334420be P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:07.412513 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531a069eeba64024abd6954b7819c916" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:01:07.412634 7297 raft_consensus.cc:3060] T 531a069eeba64024abd6954b7819c916 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:07.413676 7297 raft_consensus.cc:2468] T 531a069eeba64024abd6954b7819c916 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:01:07.413736 8745 tablet_bootstrap.cc:654] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:07.395704 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531a069eeba64024abd6954b7819c916" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
W20260502 14:01:07.414270 7511 leader_election.cc:343] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Illegal state: must be running to vote when last-logged opid is not known
I20260502 14:01:07.414523 7508 leader_election.cc:304] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84
I20260502 14:01:07.414770 8463 raft_consensus.cc:2804] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:07.414850 8463 raft_consensus.cc:697] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:01:07.415216 8745 tablet_bootstrap.cc:492] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:07.429396 8745 ts_tablet_manager.cc:1403] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
I20260502 14:01:07.429397 8463 consensus_queue.cc:237] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.430038 8745 raft_consensus.cc:359] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.430159 8745 raft_consensus.cc:385] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:07.430188 8745 raft_consensus.cc:740] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:07.430341 8745 consensus_queue.cc:260] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.430640 8745 ts_tablet_manager.cc:1434] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:07.443717 8759 raft_consensus.cc:493] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:07.443933 8759 raft_consensus.cc:515] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.444410 8759 leader_election.cc:290] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:07.445009 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634a57f067a84d7194cc4d1ecd4cbf1d" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:07.444986 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634a57f067a84d7194cc4d1ecd4cbf1d" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:01:07.445179 7434 raft_consensus.cc:2468] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:07.445179 7574 raft_consensus.cc:2468] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:07.445529 7233 leader_election.cc:304] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:07.445778 8759 raft_consensus.cc:2804] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:07.445845 8759 raft_consensus.cc:493] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:07.445899 8759 raft_consensus.cc:3060] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:07.446895 8759 raft_consensus.cc:515] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.447278 8759 leader_election.cc:290] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:07.447726 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634a57f067a84d7194cc4d1ecd4cbf1d" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:07.447868 7434 raft_consensus.cc:3060] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:07.448060 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "634a57f067a84d7194cc4d1ecd4cbf1d" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:01:07.448182 7574 raft_consensus.cc:3060] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:07.448948 7574 raft_consensus.cc:2468] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:07.448946 7434 raft_consensus.cc:2468] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:07.449293 7233 leader_election.cc:304] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:07.449596 8759 raft_consensus.cc:2804] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:07.449688 8759 raft_consensus.cc:697] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:01:07.449831 8759 consensus_queue.cc:237] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.466449 8759 raft_consensus.cc:493] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:07.466589 8759 raft_consensus.cc:515] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.467187 8759 leader_election.cc:290] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:07.467657 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48d38bb19c4730b02922ca28e0c9ff" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:01:07.467703 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48d38bb19c4730b02922ca28e0c9ff" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:07.467785 7574 raft_consensus.cc:2468] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:07.467859 7434 raft_consensus.cc:2468] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:07.468050 7233 leader_election.cc:304] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:07.468247 8759 raft_consensus.cc:2804] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:07.468308 8759 raft_consensus.cc:493] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:07.468360 8759 raft_consensus.cc:3060] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:07.469149 8759 raft_consensus.cc:515] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.469517 8759 leader_election.cc:290] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:07.469987 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48d38bb19c4730b02922ca28e0c9ff" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:01:07.470021 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b48d38bb19c4730b02922ca28e0c9ff" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:07.470112 7574 raft_consensus.cc:3060] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:07.470158 7434 raft_consensus.cc:3060] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:07.470870 7574 raft_consensus.cc:2468] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:07.471174 7434 raft_consensus.cc:2468] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:07.471575 7233 leader_election.cc:304] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:01:07.471966 8758 raft_consensus.cc:2804] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:07.472117 8758 raft_consensus.cc:697] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:01:07.472754 8758 consensus_queue.cc:237] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
W20260502 14:01:07.562496 7371 connection.cc:570] server connection from 127.0.0.1:36730 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:07.562528 7231 connection.cc:570] client connection to 127.6.125.126:45121 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:07.562588 7510 connection.cc:570] server connection from 127.0.0.1:54008 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:07.562844 7369 connection.cc:570] client connection to 127.6.125.126:45121 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:07.563057 7629 connection.cc:570] client connection to 127.6.125.126:45121 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:07.563630 7629 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.6.125.126:45121)
W20260502 14:01:07.563969 7629 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.6.125.126:45121)
W20260502 14:01:07.564083 7509 connection.cc:570] client connection to 127.6.125.126:45121 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:07.564179 7629 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.6.125.126:45121)
W20260502 14:01:07.564316 7629 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.6.125.126:45121)
W20260502 14:01:07.564608 8714 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:07.563460 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.126:45121 (local address 127.6.125.65:55981)
0502 14:01:07.564437 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:07.564500 (+ 63us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":875}
W20260502 14:01:07.564751 8710 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:07.563460 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.126:45121 (local address 127.6.125.66:50333)
0502 14:01:07.563684 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:07.563700 (+ 16us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:07.563792 (+ 92us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:07.564642 (+ 850us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":134}
W20260502 14:01:07.565508 7233 connection.cc:570] server connection from 127.0.0.1:33730 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260502 14:01:07.603389 8609 raft_consensus.cc:493] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:07.603626 8609 raft_consensus.cc:515] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:07.604187 8609 leader_election.cc:290] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:07.604651 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531a069eeba64024abd6954b7819c916" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:07.604766 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531a069eeba64024abd6954b7819c916" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:01:07.604853 7297 raft_consensus.cc:2393] T 531a069eeba64024abd6954b7819c916 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1be1472a04ae46e48d852d66903d9c84 in current term 1: Already voted for candidate c2964848cb1648a4bc2c1d671cc54f62 in this term.
I20260502 14:01:07.605618 7368 leader_election.cc:304] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84; no voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:07.605957 8609 raft_consensus.cc:3060] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:07.607281 8609 raft_consensus.cc:2749] T 531a069eeba64024abd6954b7819c916 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:01:07.834476 8776 raft_consensus.cc:493] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:01:07.834633 8776 raft_consensus.cc:515] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:07.835870 8776 leader_election.cc:290] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147)
W20260502 14:01:07.836545 8636 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:07.837347 8636 leader_election.cc:336] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:07.837512 8634 leader_election.cc:336] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
I20260502 14:01:07.837618 8634 leader_election.cc:304] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5d257c30a994bfdb03242b10606426f; no voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d
I20260502 14:01:07.837813 8776 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260502 14:01:07.891451 8759 consensus_queue.cc:1048] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:07.896929 8758 consensus_queue.cc:1048] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:07.954043 8463 consensus_queue.cc:1048] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:07.956704 8758 consensus_queue.cc:1048] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:07.956735 8759 consensus_queue.cc:1048] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:07.960843 8463 consensus_queue.cc:1048] T 531a069eeba64024abd6954b7819c916 P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:07.964437 8758 consensus_queue.cc:1048] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:07.965610 8758 consensus_queue.cc:1048] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:08.535128 8801 raft_consensus.cc:493] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:01:08.535301 8801 raft_consensus.cc:515] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:08.536043 8801 leader_election.cc:290] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147)
W20260502 14:01:08.537521 8634 leader_election.cc:336] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
W20260502 14:01:08.537782 8636 leader_election.cc:336] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:08.537948 8636 leader_election.cc:304] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5d257c30a994bfdb03242b10606426f; no voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d
I20260502 14:01:08.538129 8801 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260502 14:01:09.389262 8809 raft_consensus.cc:493] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:01:09.389441 8809 raft_consensus.cc:515] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:09.390133 8809 leader_election.cc:290] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147)
W20260502 14:01:09.391624 8634 leader_election.cc:336] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
W20260502 14:01:09.391796 8636 leader_election.cc:336] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:09.391846 8636 leader_election.cc:304] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5d257c30a994bfdb03242b10606426f; no voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d
I20260502 14:01:09.392028 8809 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260502 14:01:09.941496 8800 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:09.941658 8800 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:09.942194 8800 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:09.943041 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:01:09.943145 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:01:09.943246 7508 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:09.943392 8800 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:10.176306 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.125:46147
--webserver_interface=127.6.125.125
--webserver_port=34081
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 14:01:10.303637 8823 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:01:10.303939 8823 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:01:10.304003 8823 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:01:10.308506 8823 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 14:01:10.308591 8823 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:01:10.308619 8823 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 14:01:10.308645 8823 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 14:01:10.313705 8823 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.125:46147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.6.125.125
--webserver_port=34081
--never_fsync=true
--heap_profile_path=/tmp/kudu.8823
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:01:10.314916 8823 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:01:10.316159 8823 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:01:10.322980 8831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:01:10.322980 8829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:01:10.323287 8823 server_base.cc:1061] running on GCE node
W20260502 14:01:10.323338 8828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:01:10.324015 8823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:01:10.325012 8823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:01:10.326224 8823 hybrid_clock.cc:648] HybridClock initialized: now 1777730470326238 us; error 60 us; skew 500 ppm
I20260502 14:01:10.328824 8823 webserver.cc:492] Webserver started at http://127.6.125.125:34081/ using document root <none> and password file <none>
I20260502 14:01:10.329464 8823 fs_manager.cc:362] Metadata directory not provided
I20260502 14:01:10.329555 8823 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:01:10.333930 8823 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260502 14:01:10.336306 8837 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:01:10.337644 8823 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260502 14:01:10.337803 8823 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
uuid: "78b194cad3b9424395e9a403da13ba80"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:01:10.338244 8823 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:01:10.358542 8823 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:01:10.359225 8823 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:01:10.359395 8823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:01:10.367357 8823 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.125:46147
I20260502 14:01:10.367357 8889 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.125:46147 every 8 connection(s)
I20260502 14:01:10.368640 8823 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/info.pb
I20260502 14:01:10.373714 8890 sys_catalog.cc:263] Verifying existing consensus state
I20260502 14:01:10.374366 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 8823
I20260502 14:01:10.376021 8890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Bootstrap starting.
I20260502 14:01:10.389056 8890 log.cc:826] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Log is configured to *not* fsync() on all Append() calls
I20260502 14:01:10.445573 8890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Bootstrap replayed 1/1 log segments. Stats: ops{read=90 overwritten=0 applied=90 ignored=0} inserts{seen=54 ignored=0} mutations{seen=75 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:01:10.446084 8890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Bootstrap complete.
I20260502 14:01:10.449038 8890 raft_consensus.cc:359] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:10.449412 8890 raft_consensus.cc:740] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b194cad3b9424395e9a403da13ba80, State: Initialized, Role: FOLLOWER
I20260502 14:01:10.449817 8890 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 90, Last appended: 7.90, Last appended by leader: 90, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:10.450281 8896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:10.450404 8896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:10.451092 8890 sys_catalog.cc:565] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: configured and running, proceeding with master startup.
I20260502 14:01:10.457506 8910 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:10.457592 8910 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: loading cluster ID for follower catalog manager: success
I20260502 14:01:10.460285 8910 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: acquiring CA information for follower catalog manager: success
I20260502 14:01:10.458892 8823 master_runner.cc:186] Error getting master registration for 127.6.125.126:45121: Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111),
I20260502 14:01:10.461043 8823 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:10.462837 8910 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 14:01:10.477551 7483 heartbeater.cc:344] Connected to a master server at 127.6.125.125:46147
I20260502 14:01:10.480091 8854 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" instance_seqno: 1777730451385809) as {username='slave'} at 127.6.125.66:43283; Asking this server to re-register.
I20260502 14:01:10.480847 7483 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:10.482223 8854 ts_manager.cc:194] Registered new tserver with Master: 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:10.493777 7623 heartbeater.cc:344] Connected to a master server at 127.6.125.125:46147
I20260502 14:01:10.495142 8854 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" instance_seqno: 1777730451630765) as {username='slave'} at 127.6.125.67:57753; Asking this server to re-register.
I20260502 14:01:10.495649 7623 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:10.496901 8854 ts_manager.cc:194] Registered new tserver with Master: c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:10.500898 8800 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:10.501039 8800 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.501471 8800 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:10.502228 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:01:10.502352 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:01:10.502413 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:10.502554 8800 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:10.521685 7345 heartbeater.cc:344] Connected to a master server at 127.6.125.125:46147
I20260502 14:01:10.523325 8854 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" instance_seqno: 1777730451168368) as {username='slave'} at 127.6.125.65:40215; Asking this server to re-register.
I20260502 14:01:10.523840 7345 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:10.525076 8854 ts_manager.cc:194] Registered new tserver with Master: 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:10.750870 8918 raft_consensus.cc:493] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:01:10.751005 8918 raft_consensus.cc:515] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:10.751590 8918 leader_election.cc:290] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147)
W20260502 14:01:10.752987 8634 leader_election.cc:336] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
I20260502 14:01:10.757608 8864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 9 candidate_status { last_received { term: 8 index: 97 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80" is_pre_election: true
I20260502 14:01:10.757998 8864 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5d257c30a994bfdb03242b10606426f in term 7.
I20260502 14:01:10.758394 8636 leader_election.cc:304] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f; no voters: 9d590d630acd4892b59504b1c66c4f2d
I20260502 14:01:10.758675 8918 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260502 14:01:10.758746 8918 raft_consensus.cc:493] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:01:10.758776 8918 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 8 FOLLOWER]: Advancing to term 9
I20260502 14:01:10.759692 8918 raft_consensus.cc:515] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:10.760119 8918 leader_election.cc:290] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 election: Requested vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147)
I20260502 14:01:10.760859 8864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5d257c30a994bfdb03242b10606426f" candidate_term: 9 candidate_status { last_received { term: 8 index: 97 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80"
I20260502 14:01:10.761010 8864 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 7 FOLLOWER]: Advancing to term 9
I20260502 14:01:10.763149 8864 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5d257c30a994bfdb03242b10606426f in term 9.
I20260502 14:01:10.763839 8636 leader_election.cc:304] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f; no voters:
I20260502 14:01:10.764138 8918 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 9 FOLLOWER]: Leader election won for term 9
I20260502 14:01:10.764405 8918 raft_consensus.cc:697] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [term 9 LEADER]: Becoming Leader. State: Replica: a5d257c30a994bfdb03242b10606426f, State: Running, Role: LEADER
I20260502 14:01:10.764730 8918 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 8.97, Last appended by leader: 97, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:10.765908 8922 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5d257c30a994bfdb03242b10606426f. Latest consensus state: current_term: 9 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:10.766043 8922 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: LEADER
I20260502 14:01:10.766489 8924 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 14:01:10.768399 8924 catalog_manager.cc:679] Loaded metadata for table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]
I20260502 14:01:10.768728 8924 catalog_manager.cc:679] Loaded metadata for table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]
I20260502 14:01:10.768944 8924 catalog_manager.cc:679] Loaded metadata for table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]
I20260502 14:01:10.769169 8924 catalog_manager.cc:679] Loaded metadata for table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]
I20260502 14:01:10.769390 8924 catalog_manager.cc:679] Loaded metadata for table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]
I20260502 14:01:10.769594 8924 catalog_manager.cc:679] Loaded metadata for table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]
I20260502 14:01:10.769902 8924 catalog_manager.cc:679] Loaded metadata for table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]
I20260502 14:01:10.770159 8924 catalog_manager.cc:679] Loaded metadata for table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]
I20260502 14:01:10.770373 8924 catalog_manager.cc:679] Loaded metadata for table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]
I20260502 14:01:10.770740 8924 catalog_manager.cc:679] Loaded metadata for table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]
I20260502 14:01:10.771298 8924 catalog_manager.cc:679] Loaded metadata for table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]
I20260502 14:01:10.771559 8924 catalog_manager.cc:679] Loaded metadata for table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]
I20260502 14:01:10.773084 8924 tablet_loader.cc:96] loaded metadata for tablet 1ee6e9e5b45444a883171cc483e8a4ca (table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968])
I20260502 14:01:10.773293 8924 tablet_loader.cc:96] loaded metadata for tablet 20b64fa709284798944325339eb67a0f (table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16])
I20260502 14:01:10.773698 8924 tablet_loader.cc:96] loaded metadata for tablet 303cc2525a0d44029b77fbbbf9f12ae1 (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065])
I20260502 14:01:10.773854 8924 tablet_loader.cc:96] loaded metadata for tablet 36b15154f3cc4285a4d119da277c811d (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15])
I20260502 14:01:10.774247 8924 tablet_loader.cc:96] loaded metadata for tablet 531a069eeba64024abd6954b7819c916 (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e])
I20260502 14:01:10.774408 8924 tablet_loader.cc:96] loaded metadata for tablet 54df03f280ce41fda1d06bb316aaa33c (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86])
I20260502 14:01:10.774729 8924 tablet_loader.cc:96] loaded metadata for tablet 634a57f067a84d7194cc4d1ecd4cbf1d (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504])
I20260502 14:01:10.774879 8924 tablet_loader.cc:96] loaded metadata for tablet 69d1158bbc864a9998326d5f45fead94 (table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77])
I20260502 14:01:10.775475 8924 tablet_loader.cc:96] loaded metadata for tablet 8b48d38bb19c4730b02922ca28e0c9ff (table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f])
I20260502 14:01:10.775883 8924 tablet_loader.cc:96] loaded metadata for tablet 912c143ef13f42529ec28b08615db7dd (table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95])
I20260502 14:01:10.776129 8924 tablet_loader.cc:96] loaded metadata for tablet a1e9410673c743bdbe0b0a6cabdbbac3 (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a])
I20260502 14:01:10.776427 8924 tablet_loader.cc:96] loaded metadata for tablet b67a5c0fd2ad49fc8a8f9550567de239 (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3])
I20260502 14:01:10.777251 8924 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 14:01:10.777976 8924 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:10.778036 8924 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 14:01:10.778738 8924 catalog_manager.cc:1514] Loading token signing keys...
I20260502 14:01:10.779250 8924 catalog_manager.cc:6055] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Loaded TSK: 0
I20260502 14:01:10.779829 8924 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 14:01:10.780367 8924 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 14:01:10.780828 8924 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 16
I20260502 14:01:10.823064 8649 master_service.cc:954] ReplaceTablet: received request to replace tablet b67a5c0fd2ad49fc8a8f9550567de239 from {username='slave'} at 127.0.0.1:45508
I20260502 14:01:10.824381 8640 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45508:
name: "default.Table_438fd981a3264fd58efe636b409acfb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:10.825075 8646 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45508:
table { table_name: "default.Table_f0b8f5be35da4f878de056348eefee40" } new_table_name: "default.Table_e199b1aa26354ce2b3578613f359d8c3" modify_external_catalogs: true
I20260502 14:01:10.825407 8647 master_service.cc:954] ReplaceTablet: received request to replace tablet 1ee6e9e5b45444a883171cc483e8a4ca from {username='slave'} at 127.0.0.1:45508
I20260502 14:01:10.826157 8648 master_service.cc:954] ReplaceTablet: received request to replace tablet 634a57f067a84d7194cc4d1ecd4cbf1d from {username='slave'} at 127.0.0.1:45508
I20260502 14:01:10.826344 8644 master_service.cc:954] ReplaceTablet: received request to replace tablet 1ee6e9e5b45444a883171cc483e8a4ca from {username='slave'} at 127.0.0.1:45508
I20260502 14:01:10.826532 8642 master_service.cc:954] ReplaceTablet: received request to replace tablet 36b15154f3cc4285a4d119da277c811d from {username='slave'} at 127.0.0.1:45508
I20260502 14:01:10.828106 8641 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45508:
name: "default.Table_fb7cbf56a40a435aafcbd171a7e85925"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:10.828133 8645 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45508:
table { table_name: "default.Table_9c2adeda8ca24651b8be47c058c64d23" } new_table_name: "default.Table_a7e4568b673f4d569bb4a906a15952bf" modify_external_catalogs: true
I20260502 14:01:10.828132 8643 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45508:
table { table_name: "default.Table_da5e1cd539c94420b562a58316eecee9" } new_table_name: "default.Table_af37839f6f694cdba90e61ecb647fd39" modify_external_catalogs: true
F20260502 14:01:10.829770 8702 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 19, previous 19; dumping first 4 out of 10 received events: NotificationEvent(eventId=17, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_5bbf52ba925f45dfae2bee0f411a0316, message={"server":"","servicePrincipal":"","db":"default","table":"table_5bbf52ba925f45dfae2bee0f411a0316","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5bbf52ba925f45dfae2bee0f411a0316\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_5bbf52ba925f45dfae2bee0f411a0316\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5bbf52ba925f45dfae2bee0f411a0316\",\"kudu.table_id\":\"2e0834670d044a0fbe32ffcd671a778b\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=18, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_916010ddd67a42689b76591a02784a0a, message={"server":"","servicePrincipal":"","db":"default","table":"table_916010ddd67a42689b76591a02784a0a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_916010ddd67a42689b76591a02784a0a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_916010ddd67a42689b76591a02784a0a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_916010ddd67a42689b76591a02784a0a\",\"kudu.table_id\":\"337d1a2589374574b8d3b1735b5efe95\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_79e5262b7980424fbe659116c4785e9c, message={"server":"","servicePrincipal":"","db":"default","table":"table_79e5262b7980424fbe659116c4785e9c","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79e5262b7980424fbe659116c4785e9c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730452},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_79e5262b7980424fbe659116c4785e9c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79e5262b7980424fbe659116c4785e9c\",\"kudu.table_id\":\"2b961b00f8804350ade31c5ac13105e3\",\"transient_lastDdlTime\":\"1777730452\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_2866c4520a3d40c4b3c6ca93424e5a0b, message={"server":"","servicePrincipal":"","db":"default","table":"table_2866c4520a3d40c4b3c6ca93424e5a0b","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730453},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2866c4520a3d40c4b3c6ca93424e5a0b\",\"kudu.table_id\":\"a6606215bcc24f789f81868248dcd065\",\"transient_lastDdlTime\":\"1777730453\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive);
I20260502 14:01:10.829963 8864 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Refusing update from remote peer a5d257c30a994bfdb03242b10606426f: Log matching property violated. Preceding OpId in replica: term: 7 index: 90. Preceding OpId from leader: term: 9 index: 100. (index mismatch)
*** Check failure stack trace: ***
I20260502 14:01:10.830693 8926 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 98, Last known committed idx: 90, Time since last communication: 0.000s
@ 0x7f8de6b56dcd google::LogMessage::Fail() at ??:0
@ 0x7f8de6b5ab93 google::LogMessage::SendToLog() at ??:0
@ 0x7f8de6b567cc google::LogMessage::Flush() at ??:0
@ 0x7f8de6b56a11 google::LogMessage::~LogMessage() at ??:0
I20260502 14:01:10.839421 8896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5d257c30a994bfdb03242b10606426f. Latest consensus state: current_term: 9 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:10.839715 8896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:10.839924 8896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:10.840034 8896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:10.842624 8926 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 9 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:10.842744 8926 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f [sys.catalog]: This master's current role is: LEADER
I20260502 14:01:10.844383 8931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "a5d257c30a994bfdb03242b10606426f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:10.844524 8931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:10.845907 8649 catalog_manager.cc:5958] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Sending DeleteTablet for 3 replicas of tablet b67a5c0fd2ad49fc8a8f9550567de239
@ 0x7f8dec0ca433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 14:01:10.847113 8649 catalog_manager.cc:6741] ReplaceTablet: tablet b67a5c0fd2ad49fc8a8f9550567de239 deleted and replaced by tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a
I20260502 14:01:10.848728 8649 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45508:
table { table_name: "default.Table_916010ddd67a42689b76591a02784a0a" } modify_external_catalogs: true
I20260502 14:01:10.848896 8649 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45508:
table { table_name: "default.Table_916010ddd67a42689b76591a02784a0a" } modify_external_catalogs: true
I20260502 14:01:10.850412 8929 mvcc.cc:204] Tried to move back new op lower bound from 7281584008513716224 to 7281583993697755136. Current Snapshot: MvccSnapshot[applied={T|T < 7281584008513716224 or (T in {7281584008513716224})}]
@ 0x7f8dec0c934a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 14:01:10.851052 8648 catalog_manager.cc:5958] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Sending DeleteTablet for 3 replicas of tablet 634a57f067a84d7194cc4d1ecd4cbf1d
I20260502 14:01:10.851205 8644 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45508:
name: "default.Table_09d33df61a3f4a6480e2fe299421ae1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:10.851346 8648 catalog_manager.cc:6741] ReplaceTablet: tablet 634a57f067a84d7194cc4d1ecd4cbf1d deleted and replaced by tablet 579507458b9c43baac056c2a93902876
I20260502 14:01:10.851526 8648 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45508:
table { table_name: "default.Table_7091f4920e384b37862f746b07e5372f" } modify_external_catalogs: true
I20260502 14:01:10.851656 8648 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45508:
table { table_name: "default.Table_7091f4920e384b37862f746b07e5372f" } modify_external_catalogs: true
I20260502 14:01:10.851210 8647 catalog_manager.cc:5958] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Sending DeleteTablet for 3 replicas of tablet 1ee6e9e5b45444a883171cc483e8a4ca
I20260502 14:01:10.852217 8647 catalog_manager.cc:6741] ReplaceTablet: tablet 1ee6e9e5b45444a883171cc483e8a4ca deleted and replaced by tablet 098b67380f9440e39aebdd19788e4387
I20260502 14:01:10.852509 8647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45508:
name: "default.Table_5bbf52ba925f45dfae2bee0f411a0316"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:10.853003 8642 catalog_manager.cc:5958] T 00000000000000000000000000000000 P a5d257c30a994bfdb03242b10606426f: Sending DeleteTablet for 3 replicas of tablet 36b15154f3cc4285a4d119da277c811d
I20260502 14:01:10.853284 8642 catalog_manager.cc:6741] ReplaceTablet: tablet 36b15154f3cc4285a4d119da277c811d deleted and replaced by tablet dea5a68e885548929bced26cf2935d0a
I20260502 14:01:10.853484 8642 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45508:
table { table_name: "default.Table_0d20cbe3e06443a39d25177f4abb4de7" } new_table_name: "default.Table_2ce27412960f42de9ef1fc0a234fae45" modify_external_catalogs: true
@ 0x7f8dec0c8aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 14:01:10.858255 7552 tablet_service.cc:1558] Processing DeleteTablet for tablet b67a5c0fd2ad49fc8a8f9550567de239 with delete_type TABLET_DATA_DELETED (replaced by tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a) from {username='slave'} at 127.0.0.1:54024
@ 0x7f8dec0ce1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260502 14:01:10.858562 7555 tablet_service.cc:1558] Processing DeleteTablet for tablet 634a57f067a84d7194cc4d1ecd4cbf1d with delete_type TABLET_DATA_DELETED (replaced by tablet 579507458b9c43baac056c2a93902876) from {username='slave'} at 127.0.0.1:54024
I20260502 14:01:10.858629 7549 tablet_service.cc:1558] Processing DeleteTablet for tablet 36b15154f3cc4285a4d119da277c811d with delete_type TABLET_DATA_DELETED (replaced by tablet dea5a68e885548929bced26cf2935d0a) from {username='slave'} at 127.0.0.1:54024
I20260502 14:01:10.858717 7551 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ee6e9e5b45444a883171cc483e8a4ca with delete_type TABLET_DATA_DELETED (replaced by tablet 098b67380f9440e39aebdd19788e4387) from {username='slave'} at 127.0.0.1:54024
I20260502 14:01:10.859193 7412 tablet_service.cc:1558] Processing DeleteTablet for tablet b67a5c0fd2ad49fc8a8f9550567de239 with delete_type TABLET_DATA_DELETED (replaced by tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a) from {username='slave'} at 127.0.0.1:36742
I20260502 14:01:10.859253 7414 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ee6e9e5b45444a883171cc483e8a4ca with delete_type TABLET_DATA_DELETED (replaced by tablet 098b67380f9440e39aebdd19788e4387) from {username='slave'} at 127.0.0.1:36742
I20260502 14:01:10.859341 7409 tablet_service.cc:1558] Processing DeleteTablet for tablet 634a57f067a84d7194cc4d1ecd4cbf1d with delete_type TABLET_DATA_DELETED (replaced by tablet 579507458b9c43baac056c2a93902876) from {username='slave'} at 127.0.0.1:36742
I20260502 14:01:10.859449 7413 tablet_service.cc:1558] Processing DeleteTablet for tablet 36b15154f3cc4285a4d119da277c811d with delete_type TABLET_DATA_DELETED (replaced by tablet dea5a68e885548929bced26cf2935d0a) from {username='slave'} at 127.0.0.1:36742
@ 0x5650a1aa7244 std::function<>::operator()() at ??:0
I20260502 14:01:10.860473 7269 tablet_service.cc:1558] Processing DeleteTablet for tablet b67a5c0fd2ad49fc8a8f9550567de239 with delete_type TABLET_DATA_DELETED (replaced by tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a) from {username='slave'} at 127.0.0.1:33734
I20260502 14:01:10.860726 7273 tablet_service.cc:1558] Processing DeleteTablet for tablet 634a57f067a84d7194cc4d1ecd4cbf1d with delete_type TABLET_DATA_DELETED (replaced by tablet 579507458b9c43baac056c2a93902876) from {username='slave'} at 127.0.0.1:33734
I20260502 14:01:10.860795 7272 tablet_service.cc:1558] Processing DeleteTablet for tablet 36b15154f3cc4285a4d119da277c811d with delete_type TABLET_DATA_DELETED (replaced by tablet dea5a68e885548929bced26cf2935d0a) from {username='slave'} at 127.0.0.1:33734
I20260502 14:01:10.860879 7275 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ee6e9e5b45444a883171cc483e8a4ca with delete_type TABLET_DATA_DELETED (replaced by tablet 098b67380f9440e39aebdd19788e4387) from {username='slave'} at 127.0.0.1:33734
I20260502 14:01:10.861296 8947 tablet_replica.cc:333] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:10.861442 8947 raft_consensus.cc:2243] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:10.861562 8947 raft_consensus.cc:2272] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:10.861954 8947 ts_tablet_manager.cc:1916] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:10.862715 7275 tablet_service.cc:1511] Processing CreateTablet for tablet 579507458b9c43baac056c2a93902876 (DEFAULT_TABLE table=default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:10.862872 7413 tablet_service.cc:1511] Processing CreateTablet for tablet 579507458b9c43baac056c2a93902876 (DEFAULT_TABLE table=default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:10.862982 7275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579507458b9c43baac056c2a93902876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:10.863147 7413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579507458b9c43baac056c2a93902876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:10.864423 8948 tablet_replica.cc:333] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:10.864562 8948 raft_consensus.cc:2243] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:10.864672 8948 raft_consensus.cc:2272] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:10.865068 8948 ts_tablet_manager.cc:1916] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:10.865042 7272 tablet_service.cc:1511] Processing CreateTablet for tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:10.865336 7272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:10.866322 7551 tablet_service.cc:1511] Processing CreateTablet for tablet 579507458b9c43baac056c2a93902876 (DEFAULT_TABLE table=default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:10.866699 7549 tablet_service.cc:1511] Processing CreateTablet for tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:10.866707 7412 tablet_service.cc:1511] Processing CreateTablet for tablet 098b67380f9440e39aebdd19788e4387 (DEFAULT_TABLE table=default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:10.866927 7412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098b67380f9440e39aebdd19788e4387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:10.866990 7555 tablet_service.cc:1511] Processing CreateTablet for tablet 098b67380f9440e39aebdd19788e4387 (DEFAULT_TABLE table=default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:10.867153 8947 ts_tablet_manager.cc:1929] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:10.867192 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098b67380f9440e39aebdd19788e4387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:10.867211 8947 log.cc:1199] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/b67a5c0fd2ad49fc8a8f9550567de239
I20260502 14:01:10.867327 7413 tablet_service.cc:1511] Processing CreateTablet for tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:10.867461 8947 ts_tablet_manager.cc:1950] T b67a5c0fd2ad49fc8a8f9550567de239 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:10.867506 7549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:10.867334 7414 tablet_service.cc:1511] Processing CreateTablet for tablet dea5a68e885548929bced26cf2935d0a (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:10.867584 7273 tablet_service.cc:1511] Processing CreateTablet for tablet 098b67380f9440e39aebdd19788e4387 (DEFAULT_TABLE table=default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:10.867662 7551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 579507458b9c43baac056c2a93902876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:10.867833 7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 098b67380f9440e39aebdd19788e4387. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f8de805b7ea kudu::Thread::SuperviseThread() at ??:0
I20260502 14:01:10.869853 7552 tablet_service.cc:1511] Processing CreateTablet for tablet dea5a68e885548929bced26cf2935d0a (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:10.869952 7269 tablet_service.cc:1511] Processing CreateTablet for tablet dea5a68e885548929bced26cf2935d0a (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:10.870086 7552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea5a68e885548929bced26cf2935d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:10.870173 7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea5a68e885548929bced26cf2935d0a. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f8de899f6db start_thread at ??:0
I20260502 14:01:10.872623 8952 tablet_bootstrap.cc:492] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:10.872898 8947 tablet_replica.cc:333] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:10.873045 8947 raft_consensus.cc:2243] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:10.873160 8947 raft_consensus.cc:2272] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:10.873682 8947 ts_tablet_manager.cc:1916] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:10.873804 8636 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet b67a5c0fd2ad49fc8a8f9550567de239 (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]) successfully deleted
@ 0x7f8de5d0d61f clone at ??:0
I20260502 14:01:10.876046 8953 tablet_bootstrap.cc:492] T 579507458b9c43baac056c2a93902876 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:10.876129 8948 ts_tablet_manager.cc:1929] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:10.876201 8948 log.cc:1199] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/1ee6e9e5b45444a883171cc483e8a4ca
I20260502 14:01:10.876386 8951 tablet_bootstrap.cc:492] T 579507458b9c43baac056c2a93902876 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:10.876456 8948 ts_tablet_manager.cc:1950] T 1ee6e9e5b45444a883171cc483e8a4ca P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:10.876912 7413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:10.877182 8953 tablet_bootstrap.cc:654] T 579507458b9c43baac056c2a93902876 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:10.877277 7414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea5a68e885548929bced26cf2935d0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:10.876056 8947 ts_tablet_manager.cc:1929] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:10.877993 8947 log.cc:1199] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/634a57f067a84d7194cc4d1ecd4cbf1d
I20260502 14:01:10.878240 8947 ts_tablet_manager.cc:1950] T 634a57f067a84d7194cc4d1ecd4cbf1d P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:10.879117 8951 tablet_bootstrap.cc:654] T 579507458b9c43baac056c2a93902876 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:10.879148 8947 tablet_replica.cc:333] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:10.879281 8947 raft_consensus.cc:2243] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:10.879400 8947 raft_consensus.cc:2272] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:10.879842 8947 ts_tablet_manager.cc:1916] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:10.880034 8952 tablet_bootstrap.cc:654] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:10.881309 8952 tablet_bootstrap.cc:492] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:10.881390 8952 ts_tablet_manager.cc:1403] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20260502 14:01:10.881531 8948 tablet_replica.cc:333] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:10.881656 8948 raft_consensus.cc:2243] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:10.881821 8948 raft_consensus.cc:2272] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:10.881907 8947 ts_tablet_manager.cc:1929] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:10.881996 8947 log.cc:1199] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/36b15154f3cc4285a4d119da277c811d
I20260502 14:01:10.881943 8952 raft_consensus.cc:359] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.882042 8952 raft_consensus.cc:385] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:10.882072 8952 raft_consensus.cc:740] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:10.882194 8948 ts_tablet_manager.cc:1916] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:10.882226 8947 ts_tablet_manager.cc:1950] T 36b15154f3cc4285a4d119da277c811d P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:10.882218 8952 consensus_queue.cc:260] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.882874 8953 tablet_bootstrap.cc:492] T 579507458b9c43baac056c2a93902876 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:10.882951 8953 ts_tablet_manager.cc:1403] T 579507458b9c43baac056c2a93902876 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260502 14:01:10.883080 8947 tablet_replica.cc:333] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:10.883201 8947 raft_consensus.cc:2243] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:10.883414 8947 raft_consensus.cc:2272] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:10.883603 8953 raft_consensus.cc:359] T 579507458b9c43baac056c2a93902876 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.883705 8953 raft_consensus.cc:385] T 579507458b9c43baac056c2a93902876 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:10.883735 8953 raft_consensus.cc:740] T 579507458b9c43baac056c2a93902876 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:10.883777 8947 ts_tablet_manager.cc:1916] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:10.883845 8953 consensus_queue.cc:260] T 579507458b9c43baac056c2a93902876 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.884158 8953 ts_tablet_manager.cc:1434] T 579507458b9c43baac056c2a93902876 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:10.886003 8947 ts_tablet_manager.cc:1929] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:10.886072 8947 log.cc:1199] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/1ee6e9e5b45444a883171cc483e8a4ca
I20260502 14:01:10.886067 8952 ts_tablet_manager.cc:1434] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260502 14:01:10.886312 8947 ts_tablet_manager.cc:1950] T 1ee6e9e5b45444a883171cc483e8a4ca P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:10.887094 8949 tablet_replica.cc:333] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:10.887231 8949 raft_consensus.cc:2243] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:10.887470 8949 raft_consensus.cc:2272] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:10.887629 8953 tablet_bootstrap.cc:492] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:10.887883 8949 ts_tablet_manager.cc:1916] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:10.888249 8952 tablet_bootstrap.cc:492] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:10.888729 8953 tablet_bootstrap.cc:654] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:10.889243 8952 tablet_bootstrap.cc:654] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:10.889914 8951 tablet_bootstrap.cc:492] T 579507458b9c43baac056c2a93902876 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:10.889997 8951 ts_tablet_manager.cc:1403] T 579507458b9c43baac056c2a93902876 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20260502 14:01:10.890372 8949 ts_tablet_manager.cc:1929] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:10.890455 8949 log.cc:1199] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/b67a5c0fd2ad49fc8a8f9550567de239
I20260502 14:01:10.890410 8951 raft_consensus.cc:359] T 579507458b9c43baac056c2a93902876 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.890506 8951 raft_consensus.cc:385] T 579507458b9c43baac056c2a93902876 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:10.890527 8951 raft_consensus.cc:740] T 579507458b9c43baac056c2a93902876 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:10.890642 8951 consensus_queue.cc:260] T 579507458b9c43baac056c2a93902876 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.890714 8949 ts_tablet_manager.cc:1950] T b67a5c0fd2ad49fc8a8f9550567de239 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:10.890908 8951 ts_tablet_manager.cc:1434] T 579507458b9c43baac056c2a93902876 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:10.891075 8951 tablet_bootstrap.cc:492] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:10.893049 8948 ts_tablet_manager.cc:1929] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:10.893123 8948 log.cc:1199] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/634a57f067a84d7194cc4d1ecd4cbf1d
I20260502 14:01:10.893286 8951 tablet_bootstrap.cc:654] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:10.893373 8948 ts_tablet_manager.cc:1950] T 634a57f067a84d7194cc4d1ecd4cbf1d P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:10.894323 8948 tablet_replica.cc:333] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:10.894454 8948 raft_consensus.cc:2243] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:10.894558 8948 raft_consensus.cc:2272] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:10.894613 8953 tablet_bootstrap.cc:492] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:10.894905 8948 ts_tablet_manager.cc:1916] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:10.895381 8953 ts_tablet_manager.cc:1403] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260502 14:01:10.895961 8953 raft_consensus.cc:359] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.896067 8953 raft_consensus.cc:385] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:10.896095 8953 raft_consensus.cc:740] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:10.896258 8953 consensus_queue.cc:260] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.896989 8948 ts_tablet_manager.cc:1929] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:10.897049 8948 log.cc:1199] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/b67a5c0fd2ad49fc8a8f9550567de239
I20260502 14:01:10.897284 8948 ts_tablet_manager.cc:1950] T b67a5c0fd2ad49fc8a8f9550567de239 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:10.898023 8949 tablet_replica.cc:333] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:10.898146 8949 raft_consensus.cc:2243] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:10.898339 8949 raft_consensus.cc:2272] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:10.898729 8949 ts_tablet_manager.cc:1916] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:10.898865 8953 ts_tablet_manager.cc:1434] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 14:01:10.901558 8948 tablet_replica.cc:333] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:10.901587 8953 tablet_bootstrap.cc:492] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:10.901700 8948 raft_consensus.cc:2243] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:10.901815 8948 raft_consensus.cc:2272] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:10.902204 8948 ts_tablet_manager.cc:1916] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:10.902690 8953 tablet_bootstrap.cc:654] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:10.903961 8951 tablet_bootstrap.cc:492] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:10.904057 8951 ts_tablet_manager.cc:1403] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20260502 14:01:10.904593 8951 raft_consensus.cc:359] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.904709 8951 raft_consensus.cc:385] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:10.904738 8951 raft_consensus.cc:740] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:10.904829 8948 ts_tablet_manager.cc:1929] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:10.904901 8948 log.cc:1199] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/36b15154f3cc4285a4d119da277c811d
I20260502 14:01:10.904922 8951 consensus_queue.cc:260] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.905166 8948 ts_tablet_manager.cc:1950] T 36b15154f3cc4285a4d119da277c811d P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:10.905259 8951 ts_tablet_manager.cc:1434] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:10.905450 8951 tablet_bootstrap.cc:492] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:10.905478 8949 ts_tablet_manager.cc:1929] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:10.905556 8949 log.cc:1199] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/634a57f067a84d7194cc4d1ecd4cbf1d
I20260502 14:01:10.905848 8949 ts_tablet_manager.cc:1950] T 634a57f067a84d7194cc4d1ecd4cbf1d P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:10.906450 8951 tablet_bootstrap.cc:654] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:10.906477 8949 tablet_replica.cc:333] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:10.906601 8949 raft_consensus.cc:2243] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:10.906797 8949 raft_consensus.cc:2272] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:10.907169 8949 ts_tablet_manager.cc:1916] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:10.907658 8953 tablet_bootstrap.cc:492] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:10.907755 8953 ts_tablet_manager.cc:1403] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260502 14:01:10.908339 8953 raft_consensus.cc:359] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.908454 8953 raft_consensus.cc:385] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:10.908581 8953 raft_consensus.cc:740] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:10.908789 8953 consensus_queue.cc:260] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.909680 8949 ts_tablet_manager.cc:1929] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:10.909749 8949 log.cc:1199] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/36b15154f3cc4285a4d119da277c811d
I20260502 14:01:10.910000 8949 ts_tablet_manager.cc:1950] T 36b15154f3cc4285a4d119da277c811d P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:10.911238 8949 tablet_replica.cc:333] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:10.911365 8949 raft_consensus.cc:2243] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:10.911477 8949 raft_consensus.cc:2272] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:10.911798 8953 ts_tablet_manager.cc:1434] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260502 14:01:10.911862 8949 ts_tablet_manager.cc:1916] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:10.914091 8949 ts_tablet_manager.cc:1929] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:10.914158 8949 log.cc:1199] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/1ee6e9e5b45444a883171cc483e8a4ca
I20260502 14:01:10.914362 8953 tablet_bootstrap.cc:492] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:10.914388 8949 ts_tablet_manager.cc:1950] T 1ee6e9e5b45444a883171cc483e8a4ca P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:10.915819 8953 tablet_bootstrap.cc:654] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:10.916313 8952 tablet_bootstrap.cc:492] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:10.916388 8951 tablet_bootstrap.cc:492] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:10.916487 8951 ts_tablet_manager.cc:1403] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.001s
I20260502 14:01:10.916531 8952 ts_tablet_manager.cc:1403] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.001s
I20260502 14:01:10.917061 8951 raft_consensus.cc:359] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.917100 8952 raft_consensus.cc:359] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.917193 8951 raft_consensus.cc:385] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:10.917215 8952 raft_consensus.cc:385] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:10.917222 8953 tablet_bootstrap.cc:492] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:10.917232 8951 raft_consensus.cc:740] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:10.917248 8952 raft_consensus.cc:740] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:10.917302 8953 ts_tablet_manager.cc:1403] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.002s
I20260502 14:01:10.917495 8952 consensus_queue.cc:260] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.917546 8951 consensus_queue.cc:260] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.917838 8952 ts_tablet_manager.cc:1434] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260502 14:01:10.917872 8951 ts_tablet_manager.cc:1434] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:10.917884 8953 raft_consensus.cc:359] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.917985 8953 raft_consensus.cc:385] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:10.918015 8953 raft_consensus.cc:740] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:10.918061 8952 tablet_bootstrap.cc:492] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:10.918092 8951 tablet_bootstrap.cc:492] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:10.918134 8953 consensus_queue.cc:260] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.918407 8953 ts_tablet_manager.cc:1434] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:10.919247 8952 tablet_bootstrap.cc:654] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:10.919600 8951 tablet_bootstrap.cc:654] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:10.921772 8951 tablet_bootstrap.cc:492] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:10.921873 8951 ts_tablet_manager.cc:1403] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 14:01:10.922390 8951 raft_consensus.cc:359] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.922497 8951 raft_consensus.cc:385] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:10.922531 8951 raft_consensus.cc:740] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:10.922638 8951 consensus_queue.cc:260] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.922916 8951 ts_tablet_manager.cc:1434] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:10.925020 8952 tablet_bootstrap.cc:492] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:10.925124 8952 ts_tablet_manager.cc:1403] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260502 14:01:10.925644 8952 raft_consensus.cc:359] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.925734 8952 raft_consensus.cc:385] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:10.925755 8952 raft_consensus.cc:740] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:10.925868 8952 consensus_queue.cc:260] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.927477 8952 ts_tablet_manager.cc:1434] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260502 14:01:10.928373 8952 tablet_bootstrap.cc:492] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:10.929559 8952 tablet_bootstrap.cc:654] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:10.930998 8952 tablet_bootstrap.cc:492] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:10.931093 8952 ts_tablet_manager.cc:1403] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260502 14:01:10.931511 8952 raft_consensus.cc:359] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.931602 8952 raft_consensus.cc:385] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:10.931631 8952 raft_consensus.cc:740] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:10.931751 8952 consensus_queue.cc:260] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.932031 8952 ts_tablet_manager.cc:1434] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:10.943985 8791 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:10.944121 8791 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.944818 8791 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:10.945338 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea5a68e885548929bced26cf2935d0a" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:01:10.945384 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea5a68e885548929bced26cf2935d0a" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:10.945483 7572 raft_consensus.cc:2468] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:01:10.945572 7296 raft_consensus.cc:2468] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:01:10.945952 7371 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:10.946171 8791 raft_consensus.cc:2804] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:10.946295 8791 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:10.946381 8791 raft_consensus.cc:3060] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:10.947291 8791 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:10.947687 8791 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:10.948105 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea5a68e885548929bced26cf2935d0a" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:01:10.948089 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea5a68e885548929bced26cf2935d0a" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:01:10.948228 7572 raft_consensus.cc:3060] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:10.948228 7296 raft_consensus.cc:3060] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:10.948999 7572 raft_consensus.cc:2468] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:01:10.949309 7371 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:10.949313 7296 raft_consensus.cc:2468] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:01:10.949488 8791 raft_consensus.cc:2804] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:10.949705 8791 raft_consensus.cc:697] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:01:10.949842 8791 consensus_queue.cc:237] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:11.026458 8800 raft_consensus.cc:493] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:11.026662 8800 raft_consensus.cc:515] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:11.027216 8800 leader_election.cc:290] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:11.027712 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c10d4c1c67a4d9bb33ebcd1e231ef3a" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:11.027720 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c10d4c1c67a4d9bb33ebcd1e231ef3a" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:11.027856 7434 raft_consensus.cc:2468] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:01:11.027859 7296 raft_consensus.cc:2468] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:01:11.028223 7511 leader_election.cc:304] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:11.028415 8800 raft_consensus.cc:2804] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:11.028494 8800 raft_consensus.cc:493] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:11.028533 8800 raft_consensus.cc:3060] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:11.029388 8800 raft_consensus.cc:515] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:11.029749 8800 leader_election.cc:290] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:11.030143 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c10d4c1c67a4d9bb33ebcd1e231ef3a" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:01:11.030141 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c10d4c1c67a4d9bb33ebcd1e231ef3a" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:11.030275 7296 raft_consensus.cc:3060] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:11.030275 7434 raft_consensus.cc:3060] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:11.031245 7296 raft_consensus.cc:2468] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:01:11.031246 7434 raft_consensus.cc:2468] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:01:11.031560 7511 leader_election.cc:304] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:11.031749 8800 raft_consensus.cc:2804] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:11.031836 8800 raft_consensus.cc:697] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:01:11.032006 8800 consensus_queue.cc:237] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
W20260502 14:01:11.074390 7511 connection.cc:570] server connection from 127.0.0.1:54024 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:11.074411 7371 connection.cc:570] server connection from 127.0.0.1:36742 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:11.074411 7232 connection.cc:570] server connection from 127.0.0.1:33734 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:11.074647 7232 connection.cc:570] client connection to 127.6.125.124:43159 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:11.074676 7370 connection.cc:570] client connection to 127.6.125.124:43159 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:11.074734 7630 connection.cc:570] client connection to 127.6.125.124:43159 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:11.075155 7630 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.6.125.124:43159)
W20260502 14:01:11.075465 7630 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.6.125.124:43159)
W20260502 14:01:11.075593 7630 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.6.125.124:43159)
W20260502 14:01:11.075852 7630 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.6.125.124:43159)
W20260502 14:01:11.075867 7510 connection.cc:570] client connection to 127.6.125.124:43159 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:11.076050 8916 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:11.075304 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.124:43159 (local address 127.6.125.65:45235)
0502 14:01:11.075467 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:11.075482 (+ 15us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:11.075575 (+ 93us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:11.075927 (+ 352us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":89}
W20260502 14:01:11.076547 8710 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:11.075278 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.124:43159 (local address 127.6.125.66:56233)
0502 14:01:11.075675 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:11.075689 (+ 14us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:11.075757 (+ 68us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:11.076457 (+ 700us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":316}
I20260502 14:01:11.093291 8791 raft_consensus.cc:493] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:11.093441 8791 raft_consensus.cc:515] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:11.093819 8791 leader_election.cc:290] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:11.094230 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098b67380f9440e39aebdd19788e4387" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:01:11.094362 7572 raft_consensus.cc:2468] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:01:11.094519 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098b67380f9440e39aebdd19788e4387" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:11.094645 7371 leader_election.cc:304] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:11.094818 8791 raft_consensus.cc:2804] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:11.094668 7296 raft_consensus.cc:2468] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:01:11.094869 8791 raft_consensus.cc:493] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:11.094906 8791 raft_consensus.cc:3060] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:11.095709 8791 raft_consensus.cc:515] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:11.096199 8791 leader_election.cc:290] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:11.096607 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098b67380f9440e39aebdd19788e4387" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:01:11.096746 7572 raft_consensus.cc:3060] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:11.096758 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "098b67380f9440e39aebdd19788e4387" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:01:11.096891 7296 raft_consensus.cc:3060] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:11.097585 7572 raft_consensus.cc:2468] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:01:11.097632 7296 raft_consensus.cc:2468] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:01:11.097961 7371 leader_election.cc:304] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:11.098170 8791 raft_consensus.cc:2804] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:11.098263 8791 raft_consensus.cc:697] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:01:11.098412 8791 consensus_queue.cc:237] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:11.144129 8791 raft_consensus.cc:493] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:11.144418 8791 raft_consensus.cc:515] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:11.144896 8791 leader_election.cc:290] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:11.145390 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579507458b9c43baac056c2a93902876" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:01:11.145416 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579507458b9c43baac056c2a93902876" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:11.145530 7572 raft_consensus.cc:2468] T 579507458b9c43baac056c2a93902876 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:01:11.145557 7296 raft_consensus.cc:2468] T 579507458b9c43baac056c2a93902876 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:01:11.145838 7371 leader_election.cc:304] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:11.146008 8791 raft_consensus.cc:2804] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:11.146070 8791 raft_consensus.cc:493] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:11.146106 8791 raft_consensus.cc:3060] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:11.146914 8791 raft_consensus.cc:515] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:11.147325 8791 leader_election.cc:290] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:11.148219 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579507458b9c43baac056c2a93902876" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:01:11.148301 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "579507458b9c43baac056c2a93902876" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:01:11.148396 7572 raft_consensus.cc:3060] T 579507458b9c43baac056c2a93902876 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:11.148448 7296 raft_consensus.cc:3060] T 579507458b9c43baac056c2a93902876 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:11.149196 7572 raft_consensus.cc:2468] T 579507458b9c43baac056c2a93902876 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:01:11.149309 7296 raft_consensus.cc:2468] T 579507458b9c43baac056c2a93902876 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:01:11.149633 7371 leader_election.cc:304] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:11.149844 8791 raft_consensus.cc:2804] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:11.151021 8791 raft_consensus.cc:697] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:01:11.151271 8791 consensus_queue.cc:237] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:11.237547 8800 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:11.237704 8800 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:01:11.238121 8800 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:11.238883 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:01:11.238989 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:01:11.239049 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:11.239240 8800 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:11.329911 8791 consensus_queue.cc:1048] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:11.335129 8985 consensus_queue.cc:1048] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:11.361739 8989 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:01:11.361896 8989 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:11.363129 8989 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:11.363865 8840 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:11.364657 8839 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
W20260502 14:01:11.364784 8840 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:11.364856 8840 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80; no voters: 9d590d630acd4892b59504b1c66c4f2d, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:11.365059 8989 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260502 14:01:11.526125 8800 consensus_queue.cc:1048] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:11.530850 8800 consensus_queue.cc:1048] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:11.552207 8791 consensus_queue.cc:1048] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:11.556296 8975 consensus_queue.cc:1048] T 579507458b9c43baac056c2a93902876 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:11.676843 8791 consensus_queue.cc:1048] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:11.680352 8999 consensus_queue.cc:1048] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:11.957154 9002 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:01:11.957342 9002 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:11.957814 9002 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:11.959122 8840 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:11.959230 8839 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
I20260502 14:01:11.959350 8839 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80; no voters: 9d590d630acd4892b59504b1c66c4f2d, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:11.959604 9002 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260502 14:01:12.736151 9014 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:01:12.736308 9014 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:12.736790 9014 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:12.737931 8840 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:12.738034 8839 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
I20260502 14:01:12.738111 8839 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80; no voters: 9d590d630acd4892b59504b1c66c4f2d, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:12.738350 9014 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260502 14:01:13.144490 8800 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:13.144632 8800 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:01:13.145262 8800 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:13.145977 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:01:13.146425 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:01:13.146505 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:13.146693 8800 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:13.488739 8800 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:13.488890 8800 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:13.489369 8800 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:13.490199 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:01:13.490362 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:01:13.490451 7508 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:13.490739 8800 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:13.647059 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--webserver_interface=127.6.125.126
--webserver_port=39397
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 14:01:13.775557 9029 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:01:13.775871 9029 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:01:13.775981 9029 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:01:13.780990 9029 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 14:01:13.781108 9029 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:01:13.781141 9029 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 14:01:13.781257 9029 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 14:01:13.788440 9029 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.125.126
--webserver_port=39397
--never_fsync=true
--heap_profile_path=/tmp/kudu.9029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:01:13.789736 9029 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:01:13.791018 9029 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:01:13.797966 9037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:01:13.798856 9039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:01:13.799049 9029 server_base.cc:1061] running on GCE node
W20260502 14:01:13.798899 9036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:01:13.800232 9029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:01:13.801796 9029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:01:13.803020 9029 hybrid_clock.cc:648] HybridClock initialized: now 1777730473803000 us; error 46 us; skew 500 ppm
I20260502 14:01:13.805449 9029 webserver.cc:492] Webserver started at http://127.6.125.126:39397/ using document root <none> and password file <none>
I20260502 14:01:13.806195 9029 fs_manager.cc:362] Metadata directory not provided
I20260502 14:01:13.806294 9029 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:01:13.810724 9029 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260502 14:01:13.814224 9045 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:01:13.815989 9029 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260502 14:01:13.816141 9029 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
uuid: "9d590d630acd4892b59504b1c66c4f2d"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:01:13.816728 9029 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:01:13.834559 9029 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:01:13.835331 9029 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:01:13.836745 9029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:01:13.846710 9029 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.126:45121
I20260502 14:01:13.847033 9097 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.126:45121 every 8 connection(s)
I20260502 14:01:13.848219 9029 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
I20260502 14:01:13.853019 9098 sys_catalog.cc:263] Verifying existing consensus state
I20260502 14:01:13.854946 9098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap starting.
I20260502 14:01:13.857885 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 9029
I20260502 14:01:13.867877 9098 log.cc:826] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Log is configured to *not* fsync() on all Append() calls
I20260502 14:01:13.930620 9098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=97 overwritten=0 applied=97 ignored=0} inserts{seen=58 ignored=0} mutations{seen=83 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:01:13.931064 9098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap complete.
I20260502 14:01:13.935741 9098 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:13.936163 9098 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d590d630acd4892b59504b1c66c4f2d, State: Initialized, Role: FOLLOWER
I20260502 14:01:13.937390 9098 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 97, Last appended: 8.97, Last appended by leader: 97, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:13.938433 9102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:13.938591 9102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:13.939005 9098 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: configured and running, proceeding with master startup.
I20260502 14:01:13.947818 9116 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:13.948030 9116 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: loading cluster ID for follower catalog manager: success
I20260502 14:01:13.951092 9116 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: acquiring CA information for follower catalog manager: success
I20260502 14:01:13.957800 9116 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 14:01:13.964882 7621 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:01:13.965071 7621 heartbeater.cc:499] Master 127.6.125.126:45121 was elected leader, sending a full tablet report...
I20260502 14:01:13.970692 9061 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" instance_seqno: 1777730451630765) as {username='slave'} at 127.6.125.67:59863; Asking this server to re-register.
I20260502 14:01:13.972021 7621 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:13.973778 9061 ts_manager.cc:194] Registered new tserver with Master: c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:13.971225 9029 master_runner.cc:186] Error getting master registration for 127.6.125.124:43159: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111),
I20260502 14:01:13.974532 9029 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:14.019270 9124 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:01:14.019503 9124 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:14.020042 9124 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:14.021497 8840 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:14.025506 9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 10 candidate_status { last_received { term: 9 index: 103 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d" is_pre_election: true
I20260502 14:01:14.025913 9072 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78b194cad3b9424395e9a403da13ba80 in term 8.
I20260502 14:01:14.026758 8839 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters: a5d257c30a994bfdb03242b10606426f
I20260502 14:01:14.027050 9124 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260502 14:01:14.027223 9124 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a5d257c30a994bfdb03242b10606426f)
I20260502 14:01:14.027276 9124 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 9 FOLLOWER]: Advancing to term 10
I20260502 14:01:14.028280 9124 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:14.028704 9124 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 election: Requested vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:01:14.029088 9072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 10 candidate_status { last_received { term: 9 index: 103 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d"
I20260502 14:01:14.029237 9072 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 8 FOLLOWER]: Advancing to term 10
W20260502 14:01:14.029881 8840 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:14.031569 9072 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b194cad3b9424395e9a403da13ba80 in term 10.
I20260502 14:01:14.031877 8839 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters: a5d257c30a994bfdb03242b10606426f
I20260502 14:01:14.032073 9124 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 10 FOLLOWER]: Leader election won for term 10
I20260502 14:01:14.032457 9124 raft_consensus.cc:697] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 10 LEADER]: Becoming Leader. State: Replica: 78b194cad3b9424395e9a403da13ba80, State: Running, Role: LEADER
I20260502 14:01:14.032790 9124 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 9.103, Last appended by leader: 103, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:14.033924 9128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78b194cad3b9424395e9a403da13ba80. Latest consensus state: current_term: 10 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:14.034022 9128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: LEADER
I20260502 14:01:14.034405 9130 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 14:01:14.036134 9130 catalog_manager.cc:679] Loaded metadata for table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]
I20260502 14:01:14.036478 9130 catalog_manager.cc:679] Loaded metadata for table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]
I20260502 14:01:14.036708 9130 catalog_manager.cc:679] Loaded metadata for table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]
I20260502 14:01:14.036934 9130 catalog_manager.cc:679] Loaded metadata for table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]
I20260502 14:01:14.037142 9130 catalog_manager.cc:679] Loaded metadata for table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]
I20260502 14:01:14.037479 9130 catalog_manager.cc:679] Loaded metadata for table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]
I20260502 14:01:14.037724 9130 catalog_manager.cc:679] Loaded metadata for table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]
I20260502 14:01:14.037943 9130 catalog_manager.cc:679] Loaded metadata for table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]
I20260502 14:01:14.038180 9130 catalog_manager.cc:679] Loaded metadata for table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]
I20260502 14:01:14.038707 9130 catalog_manager.cc:679] Loaded metadata for table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]
I20260502 14:01:14.039391 9130 catalog_manager.cc:679] Loaded metadata for table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]
I20260502 14:01:14.039696 9130 catalog_manager.cc:679] Loaded metadata for table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]
I20260502 14:01:14.041570 9130 tablet_loader.cc:96] loaded metadata for tablet 098b67380f9440e39aebdd19788e4387 (table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968])
I20260502 14:01:14.041963 9130 tablet_loader.cc:96] loaded metadata for tablet 20b64fa709284798944325339eb67a0f (table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16])
I20260502 14:01:14.042374 9130 tablet_loader.cc:96] loaded metadata for tablet 303cc2525a0d44029b77fbbbf9f12ae1 (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065])
I20260502 14:01:14.042938 9130 tablet_loader.cc:96] loaded metadata for tablet 531a069eeba64024abd6954b7819c916 (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e])
I20260502 14:01:14.043133 9130 tablet_loader.cc:96] loaded metadata for tablet 54df03f280ce41fda1d06bb316aaa33c (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86])
I20260502 14:01:14.043301 9130 tablet_loader.cc:96] loaded metadata for tablet 579507458b9c43baac056c2a93902876 (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504])
I20260502 14:01:14.043721 9130 tablet_loader.cc:96] loaded metadata for tablet 69d1158bbc864a9998326d5f45fead94 (table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77])
I20260502 14:01:14.044492 9130 tablet_loader.cc:96] loaded metadata for tablet 8b48d38bb19c4730b02922ca28e0c9ff (table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f])
I20260502 14:01:14.044726 9130 tablet_loader.cc:96] loaded metadata for tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3])
I20260502 14:01:14.045014 9130 tablet_loader.cc:96] loaded metadata for tablet 912c143ef13f42529ec28b08615db7dd (table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95])
I20260502 14:01:14.045181 9130 tablet_loader.cc:96] loaded metadata for tablet a1e9410673c743bdbe0b0a6cabdbbac3 (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a])
I20260502 14:01:14.045975 9130 tablet_loader.cc:96] loaded metadata for tablet dea5a68e885548929bced26cf2935d0a (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15])
I20260502 14:01:14.046314 9130 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 14:01:14.047559 9130 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:14.047669 9130 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 14:01:14.048768 9130 catalog_manager.cc:1514] Loading token signing keys...
I20260502 14:01:14.049413 9130 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Loaded TSK: 0
I20260502 14:01:14.050017 9130 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 14:01:14.050653 9130 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 14:01:14.051259 9130 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 16
I20260502 14:01:14.127969 8851 master_service.cc:954] ReplaceTablet: received request to replace tablet 20b64fa709284798944325339eb67a0f from {username='slave'} at 127.0.0.1:32884
I20260502 14:01:14.127974 8854 master_service.cc:954] ReplaceTablet: received request to replace tablet dea5a68e885548929bced26cf2935d0a from {username='slave'} at 127.0.0.1:32884
I20260502 14:01:14.128954 8853 master_service.cc:954] ReplaceTablet: received request to replace tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a from {username='slave'} at 127.0.0.1:32884
I20260502 14:01:14.129637 8849 master_service.cc:954] ReplaceTablet: received request to replace tablet 912c143ef13f42529ec28b08615db7dd from {username='slave'} at 127.0.0.1:32884
I20260502 14:01:14.129980 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32884:
name: "default.Table_4534fe13c1d94c399d9c725c85deb6d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:14.130303 8848 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32884:
name: "default.Table_ceee0100290949a6bc0c7926ef8c981e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:14.127835 8852 master_service.cc:954] ReplaceTablet: received request to replace tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a from {username='slave'} at 127.0.0.1:32884
I20260502 14:01:14.130956 8845 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32884:
name: "default.Table_c3fa81d759a04db897e93aa688729318"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:14.131013 8846 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:32884:
table { table_name: "default.Table_e209f5be8519489e973e7a888ad911ee" } modify_external_catalogs: true
I20260502 14:01:14.131148 8846 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:32884:
table { table_name: "default.Table_e209f5be8519489e973e7a888ad911ee" } modify_external_catalogs: true
I20260502 14:01:14.132128 9072 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Refusing update from remote peer 78b194cad3b9424395e9a403da13ba80: Log matching property violated. Preceding OpId in replica: term: 8 index: 97. Preceding OpId from leader: term: 10 index: 105. (index mismatch)
I20260502 14:01:14.132715 9128 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 104, Last known committed idx: 97, Time since last communication: 0.000s
I20260502 14:01:14.134862 8847 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32884:
name: "default.Table_3803b7a44d4847adabbc5a04821f0382"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:14.137988 9102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78b194cad3b9424395e9a403da13ba80. Latest consensus state: current_term: 10 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:14.138144 9102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:14.138236 9102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 10 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:14.138295 9102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
F20260502 14:01:14.140380 8909 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 19, previous 19; dumping first 4 out of 10 received events: NotificationEvent(eventId=17, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_5bbf52ba925f45dfae2bee0f411a0316, message={"server":"","servicePrincipal":"","db":"default","table":"table_5bbf52ba925f45dfae2bee0f411a0316","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5bbf52ba925f45dfae2bee0f411a0316\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_5bbf52ba925f45dfae2bee0f411a0316\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5bbf52ba925f45dfae2bee0f411a0316\",\"kudu.table_id\":\"2e0834670d044a0fbe32ffcd671a778b\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=18, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_916010ddd67a42689b76591a02784a0a, message={"server":"","servicePrincipal":"","db":"default","table":"table_916010ddd67a42689b76591a02784a0a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_916010ddd67a42689b76591a02784a0a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_916010ddd67a42689b76591a02784a0a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_916010ddd67a42689b76591a02784a0a\",\"kudu.table_id\":\"337d1a2589374574b8d3b1735b5efe95\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_79e5262b7980424fbe659116c4785e9c, message={"server":"","servicePrincipal":"","db":"default","table":"table_79e5262b7980424fbe659116c4785e9c","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79e5262b7980424fbe659116c4785e9c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730452},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_79e5262b7980424fbe659116c4785e9c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79e5262b7980424fbe659116c4785e9c\",\"kudu.table_id\":\"2b961b00f8804350ade31c5ac13105e3\",\"transient_lastDdlTime\":\"1777730452\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_2866c4520a3d40c4b3c6ca93424e5a0b, message={"server":"","servicePrincipal":"","db":"default","table":"table_2866c4520a3d40c4b3c6ca93424e5a0b","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730453},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2866c4520a3d40c4b3c6ca93424e5a0b\",\"kudu.table_id\":\"a6606215bcc24f789f81868248dcd065\",\"transient_lastDdlTime\":\"1777730453\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260502 14:01:14.141304 9132 mvcc.cc:204] Tried to move back new op lower bound from 7281584008629932032 to 7281584008255000576. Current Snapshot: MvccSnapshot[applied={T|T < 7281584008629932032 or (T in {7281584008629932032})}]
I20260502 14:01:14.142710 9128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 10 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:14.142851 9128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: LEADER
I20260502 14:01:14.144649 9134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 10 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:14.144781 9134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f14f7a44dcd google::LogMessage::Fail() at ??:0
@ 0x7f14f7a48b93 google::LogMessage::SendToLog() at ??:0
I20260502 14:01:14.149001 7481 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:01:14.149092 8854 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet dea5a68e885548929bced26cf2935d0a
W20260502 14:01:14.149564 8840 consensus_peers.cc:597] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 -> Peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Couldn't send request to peer a5d257c30a994bfdb03242b10606426f. Status: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260502 14:01:14.150288 8854 catalog_manager.cc:6741] ReplaceTablet: tablet dea5a68e885548929bced26cf2935d0a deleted and replaced by tablet 0dd5786e138748adbc73008a40dd6b65
I20260502 14:01:14.150476 9061 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" instance_seqno: 1777730451385809) as {username='slave'} at 127.6.125.66:42777; Asking this server to re-register.
I20260502 14:01:14.150969 7481 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:14.151229 8853 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a
I20260502 14:01:14.151381 8854 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32884:
name: "default.Table_afe9c083ff0b4d1487651533fee05e6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:14.151484 8853 catalog_manager.cc:6741] ReplaceTablet: tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a deleted and replaced by tablet 57513cd50186404f9ecc9f729a4c7071
I20260502 14:01:14.151669 8853 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:32884:
table { table_name: "default.Table_0912854d0fb44cf69bf731fbb257be24" } modify_external_catalogs: true
I20260502 14:01:14.151767 8853 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:32884:
table { table_name: "default.Table_0912854d0fb44cf69bf731fbb257be24" } modify_external_catalogs: true
I20260502 14:01:14.152019 9061 ts_manager.cc:194] Registered new tserver with Master: 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:14.152582 8849 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet 912c143ef13f42529ec28b08615db7dd
I20260502 14:01:14.152817 8849 catalog_manager.cc:6741] ReplaceTablet: tablet 912c143ef13f42529ec28b08615db7dd deleted and replaced by tablet f98e519df42e4ee092cd0931b2abf849
I20260502 14:01:14.153019 8849 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:32884:
table { table_name: "default.Table_d303c0450b934f2bb0f8ab01b92f2e67" } new_table_name: "default.Table_18b522eec8284015942366c63506ec7e" modify_external_catalogs: true
@ 0x7f14f7a447cc google::LogMessage::Flush() at ??:0
I20260502 14:01:14.153558 8852 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32884:
name: "default.Table_116f97550c144f10bc14cc8c29c1d169"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7f14f7a44a11 google::LogMessage::~LogMessage() at ??:0
I20260502 14:01:14.160228 7269 tablet_service.cc:1558] Processing DeleteTablet for tablet dea5a68e885548929bced26cf2935d0a with delete_type TABLET_DATA_DELETED (replaced by tablet 0dd5786e138748adbc73008a40dd6b65) from {username='slave'} at 127.0.0.1:33738
I20260502 14:01:14.160516 7273 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a with delete_type TABLET_DATA_DELETED (replaced by tablet 57513cd50186404f9ecc9f729a4c7071) from {username='slave'} at 127.0.0.1:33738
I20260502 14:01:14.160620 7272 tablet_service.cc:1558] Processing DeleteTablet for tablet 912c143ef13f42529ec28b08615db7dd with delete_type TABLET_DATA_DELETED (replaced by tablet f98e519df42e4ee092cd0931b2abf849) from {username='slave'} at 127.0.0.1:33738
I20260502 14:01:14.161458 8851 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet 20b64fa709284798944325339eb67a0f
I20260502 14:01:14.161792 8851 catalog_manager.cc:6741] ReplaceTablet: tablet 20b64fa709284798944325339eb67a0f deleted and replaced by tablet 07bd5e1e8b8b4d5a826be923a2198f00
I20260502 14:01:14.162036 8851 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:32884:
table { table_name: "default.Table_9c2adeda8ca24651b8be47c058c64d23" } new_table_name: "default.Table_a7e4568b673f4d569bb4a906a15952bf" modify_external_catalogs: true
@ 0x7f14fcfb8433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 14:01:14.162604 7272 tablet_service.cc:1558] Processing DeleteTablet for tablet 20b64fa709284798944325339eb67a0f with delete_type TABLET_DATA_DELETED (replaced by tablet 07bd5e1e8b8b4d5a826be923a2198f00) from {username='slave'} at 127.0.0.1:33738
I20260502 14:01:14.163936 7414 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c10d4c1c67a4d9bb33ebcd1e231ef3a with delete_type TABLET_DATA_DELETED (replaced by tablet 57513cd50186404f9ecc9f729a4c7071) from {username='slave'} at 127.0.0.1:36748
I20260502 14:01:14.164119 7412 tablet_service.cc:1558] Processing DeleteTablet for tablet 912c143ef13f42529ec28b08615db7dd with delete_type TABLET_DATA_DELETED (replaced by tablet f98e519df42e4ee092cd0931b2abf849) from {username='slave'} at 127.0.0.1:36748
I20260502 14:01:14.164213 7409 tablet_service.cc:1558] Processing DeleteTablet for tablet 20b64fa709284798944325339eb67a0f with delete_type TABLET_DATA_DELETED (replaced by tablet 07bd5e1e8b8b4d5a826be923a2198f00) from {username='slave'} at 127.0.0.1:36748
I20260502 14:01:14.164279 7413 tablet_service.cc:1558] Processing DeleteTablet for tablet dea5a68e885548929bced26cf2935d0a with delete_type TABLET_DATA_DELETED (replaced by tablet 0dd5786e138748adbc73008a40dd6b65) from {username='slave'} at 127.0.0.1:36748
I20260502 14:01:14.165324 9149 tablet_replica.cc:333] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:14.165474 9149 raft_consensus.cc:2243] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:14.165593 9149 raft_consensus.cc:2272] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:14.165567 7413 tablet_service.cc:1511] Processing CreateTablet for tablet 57513cd50186404f9ecc9f729a4c7071 (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:14.165572 7409 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd5786e138748adbc73008a40dd6b65 (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:14.165886 7413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57513cd50186404f9ecc9f729a4c7071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:14.166009 9149 ts_tablet_manager.cc:1916] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:14.166062 7409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd5786e138748adbc73008a40dd6b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:14.166249 9148 tablet_replica.cc:333] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:14.166391 9148 raft_consensus.cc:2243] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:14.166498 9148 raft_consensus.cc:2272] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:14.166671 7273 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd5786e138748adbc73008a40dd6b65 (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:14.166844 9148 ts_tablet_manager.cc:1916] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:14.166922 7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd5786e138748adbc73008a40dd6b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:14.169358 7272 tablet_service.cc:1511] Processing CreateTablet for tablet 57513cd50186404f9ecc9f729a4c7071 (DEFAULT_TABLE table=default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:14.170902 9151 tablet_bootstrap.cc:492] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:14.171555 9149 ts_tablet_manager.cc:1929] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:14.171639 9149 log.cc:1199] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/8c10d4c1c67a4d9bb33ebcd1e231ef3a
I20260502 14:01:14.171948 9149 ts_tablet_manager.cc:1950] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:14.171986 9151 tablet_bootstrap.cc:654] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:14.172205 7272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57513cd50186404f9ecc9f729a4c7071. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f14fcfb734a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 14:01:14.172796 9150 tablet_bootstrap.cc:492] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:14.174105 9150 tablet_bootstrap.cc:654] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
@ 0x7f14fcfb6aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 14:01:14.176600 7409 tablet_service.cc:1511] Processing CreateTablet for tablet 07bd5e1e8b8b4d5a826be923a2198f00 (DEFAULT_TABLE table=default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:14.176862 7409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07bd5e1e8b8b4d5a826be923a2198f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:14.177083 7272 tablet_service.cc:1511] Processing CreateTablet for tablet 07bd5e1e8b8b4d5a826be923a2198f00 (DEFAULT_TABLE table=default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:14.177331 7272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07bd5e1e8b8b4d5a826be923a2198f00. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f14fcfbc1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x560acc33c244 std::function<>::operator()() at ??:0
I20260502 14:01:14.180212 7409 tablet_service.cc:1511] Processing CreateTablet for tablet f98e519df42e4ee092cd0931b2abf849 (DEFAULT_TABLE table=default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:14.180670 7409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f98e519df42e4ee092cd0931b2abf849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:14.180927 7273 tablet_service.cc:1511] Processing CreateTablet for tablet f98e519df42e4ee092cd0931b2abf849 (DEFAULT_TABLE table=default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:14.181198 7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f98e519df42e4ee092cd0931b2abf849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:14.172199 9148 ts_tablet_manager.cc:1929] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:14.181985 9148 log.cc:1199] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/dea5a68e885548929bced26cf2935d0a
@ 0x7f14f8f497ea kudu::Thread::SuperviseThread() at ??:0
I20260502 14:01:14.182399 9148 ts_tablet_manager.cc:1950] T dea5a68e885548929bced26cf2935d0a P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:14.183202 8838 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet dea5a68e885548929bced26cf2935d0a (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]) successfully deleted
I20260502 14:01:14.183707 9148 tablet_replica.cc:333] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:14.183835 9148 raft_consensus.cc:2243] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:14.183964 9148 raft_consensus.cc:2272] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:14.184118 9151 tablet_bootstrap.cc:492] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:14.184196 9151 ts_tablet_manager.cc:1403] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260502 14:01:14.184341 9148 ts_tablet_manager.cc:1916] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f14f988d6db start_thread at ??:0
I20260502 14:01:14.184646 9151 raft_consensus.cc:359] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.184743 9151 raft_consensus.cc:385] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:14.184769 9151 raft_consensus.cc:740] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:14.184907 9151 consensus_queue.cc:260] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
@ 0x7f14f6bfb61f clone at ??:0
I20260502 14:01:14.187265 9149 tablet_replica.cc:333] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:14.187412 9149 raft_consensus.cc:2243] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:14.187517 9149 raft_consensus.cc:2272] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:14.187592 9151 ts_tablet_manager.cc:1434] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 14:01:14.187606 9148 ts_tablet_manager.cc:1929] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:14.187736 9148 log.cc:1199] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/8c10d4c1c67a4d9bb33ebcd1e231ef3a
I20260502 14:01:14.188004 9149 ts_tablet_manager.cc:1916] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:14.188050 9148 ts_tablet_manager.cc:1950] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:14.189363 9151 tablet_bootstrap.cc:492] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:14.189915 9149 ts_tablet_manager.cc:1929] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:14.189972 9149 log.cc:1199] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/912c143ef13f42529ec28b08615db7dd
I20260502 14:01:14.190181 9149 ts_tablet_manager.cc:1950] T 912c143ef13f42529ec28b08615db7dd P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:14.190420 9151 tablet_bootstrap.cc:654] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:14.190482 7343 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:01:14.191110 9148 tablet_replica.cc:333] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:14.191243 9148 raft_consensus.cc:2243] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:14.191354 9148 raft_consensus.cc:2272] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:14.191696 9148 ts_tablet_manager.cc:1916] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:14.191733 9061 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" instance_seqno: 1777730451168368) as {username='slave'} at 127.6.125.65:52767; Asking this server to re-register.
I20260502 14:01:14.191823 9150 tablet_bootstrap.cc:492] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:14.191959 9150 ts_tablet_manager.cc:1403] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20260502 14:01:14.192384 7343 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:14.192577 9150 raft_consensus.cc:359] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.192682 9150 raft_consensus.cc:385] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:14.192708 9150 raft_consensus.cc:740] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:14.192864 9150 consensus_queue.cc:260] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.193504 9061 ts_manager.cc:194] Registered new tserver with Master: 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:14.193598 7483 heartbeater.cc:499] Master 127.6.125.125:46147 was elected leader, sending a full tablet report...
I20260502 14:01:14.194039 9148 ts_tablet_manager.cc:1929] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:14.194103 9148 log.cc:1199] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/912c143ef13f42529ec28b08615db7dd
I20260502 14:01:14.194343 9148 ts_tablet_manager.cc:1950] T 912c143ef13f42529ec28b08615db7dd P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:14.195592 9148 tablet_replica.cc:333] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:14.195725 9148 raft_consensus.cc:2243] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:14.197111 9148 raft_consensus.cc:2272] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:14.197325 9150 ts_tablet_manager.cc:1434] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260502 14:01:14.197575 9148 ts_tablet_manager.cc:1916] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:14.199580 9150 tablet_bootstrap.cc:492] T 57513cd50186404f9ecc9f729a4c7071 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:14.200037 9148 ts_tablet_manager.cc:1929] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 14:01:14.200103 9148 log.cc:1199] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/20b64fa709284798944325339eb67a0f
I20260502 14:01:14.200337 9148 ts_tablet_manager.cc:1950] T 20b64fa709284798944325339eb67a0f P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:14.200800 9150 tablet_bootstrap.cc:654] T 57513cd50186404f9ecc9f729a4c7071 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:14.200925 9151 tablet_bootstrap.cc:492] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:14.201015 9151 ts_tablet_manager.cc:1403] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260502 14:01:14.201530 9151 raft_consensus.cc:359] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.201645 9151 raft_consensus.cc:385] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:14.201678 9151 raft_consensus.cc:740] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:14.201825 9151 consensus_queue.cc:260] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.201938 9150 tablet_bootstrap.cc:492] T 57513cd50186404f9ecc9f729a4c7071 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:14.202032 9150 ts_tablet_manager.cc:1403] T 57513cd50186404f9ecc9f729a4c7071 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:14.202239 9151 ts_tablet_manager.cc:1434] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:14.202472 9151 tablet_bootstrap.cc:492] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:14.202760 9150 raft_consensus.cc:359] T 57513cd50186404f9ecc9f729a4c7071 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.202894 9150 raft_consensus.cc:385] T 57513cd50186404f9ecc9f729a4c7071 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:14.202931 9150 raft_consensus.cc:740] T 57513cd50186404f9ecc9f729a4c7071 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:14.203066 9150 consensus_queue.cc:260] T 57513cd50186404f9ecc9f729a4c7071 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.203442 9150 ts_tablet_manager.cc:1434] T 57513cd50186404f9ecc9f729a4c7071 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260502 14:01:14.203611 9149 tablet_replica.cc:333] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:14.203630 9150 tablet_bootstrap.cc:492] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:14.203716 9149 raft_consensus.cc:2243] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:14.203723 9151 tablet_bootstrap.cc:654] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:14.203817 9149 raft_consensus.cc:2272] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:14.204265 9149 ts_tablet_manager.cc:1916] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:14.207657 9149 ts_tablet_manager.cc:1929] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260502 14:01:14.207746 9149 log.cc:1199] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/20b64fa709284798944325339eb67a0f
I20260502 14:01:14.208052 9149 ts_tablet_manager.cc:1950] T 20b64fa709284798944325339eb67a0f P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:14.208858 9150 tablet_bootstrap.cc:654] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:14.209124 9151 tablet_bootstrap.cc:492] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:14.209179 9149 tablet_replica.cc:333] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:14.209230 9151 ts_tablet_manager.cc:1403] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260502 14:01:14.209304 9149 raft_consensus.cc:2243] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:14.209515 9149 raft_consensus.cc:2272] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:14.209753 9151 raft_consensus.cc:359] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.209867 9151 raft_consensus.cc:385] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:14.209896 9151 raft_consensus.cc:740] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:14.210035 9151 consensus_queue.cc:260] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.210012 9149 ts_tablet_manager.cc:1916] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:14.210331 9151 ts_tablet_manager.cc:1434] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:14.212260 9151 tablet_bootstrap.cc:492] T f98e519df42e4ee092cd0931b2abf849 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:14.213330 9151 tablet_bootstrap.cc:654] T f98e519df42e4ee092cd0931b2abf849 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:14.213702 9149 ts_tablet_manager.cc:1929] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:14.213778 9150 tablet_bootstrap.cc:492] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:14.214538 9150 ts_tablet_manager.cc:1403] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260502 14:01:14.213779 9149 log.cc:1199] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/dea5a68e885548929bced26cf2935d0a
I20260502 14:01:14.214963 9151 tablet_bootstrap.cc:492] T f98e519df42e4ee092cd0931b2abf849 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:14.215040 9149 ts_tablet_manager.cc:1950] T dea5a68e885548929bced26cf2935d0a P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:14.215044 9151 ts_tablet_manager.cc:1403] T f98e519df42e4ee092cd0931b2abf849 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:14.215375 9150 raft_consensus.cc:359] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.215493 9150 raft_consensus.cc:385] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:14.215524 9150 raft_consensus.cc:740] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:14.215646 9150 consensus_queue.cc:260] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.215857 9151 raft_consensus.cc:359] T f98e519df42e4ee092cd0931b2abf849 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.215994 9151 raft_consensus.cc:385] T f98e519df42e4ee092cd0931b2abf849 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:14.215988 9150 ts_tablet_manager.cc:1434] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:14.216027 9151 raft_consensus.cc:740] T f98e519df42e4ee092cd0931b2abf849 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:14.216142 9150 tablet_bootstrap.cc:492] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:14.216184 9151 consensus_queue.cc:260] T f98e519df42e4ee092cd0931b2abf849 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.217232 9151 ts_tablet_manager.cc:1434] T f98e519df42e4ee092cd0931b2abf849 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260502 14:01:14.217376 9150 tablet_bootstrap.cc:654] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:14.218564 9150 tablet_bootstrap.cc:492] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:14.218655 9150 ts_tablet_manager.cc:1403] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:14.219101 9150 raft_consensus.cc:359] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.219204 9150 raft_consensus.cc:385] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:14.219237 9150 raft_consensus.cc:740] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:14.219365 9150 consensus_queue.cc:260] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.219636 9150 ts_tablet_manager.cc:1434] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:14.228231 9018 raft_consensus.cc:493] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:14.228385 9018 raft_consensus.cc:515] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
W20260502 14:01:14.228822 7508 consensus_peers.cc:597] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 912c143ef13f42529ec28b08615db7dd. This is attempt 1: this message will repeat every 5th retry.
I20260502 14:01:14.228961 9018 leader_election.cc:290] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:14.229512 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57513cd50186404f9ecc9f729a4c7071" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:14.229655 7434 raft_consensus.cc:2468] T 57513cd50186404f9ecc9f729a4c7071 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:14.229962 7233 leader_election.cc:304] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
W20260502 14:01:14.230163 7233 leader_election.cc:343] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 57513cd50186404f9ecc9f729a4c7071
I20260502 14:01:14.230170 9018 raft_consensus.cc:2804] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:14.230270 9018 raft_consensus.cc:493] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:14.230309 9018 raft_consensus.cc:3060] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:14.231468 9018 raft_consensus.cc:515] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.231873 9018 leader_election.cc:290] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:14.232755 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57513cd50186404f9ecc9f729a4c7071" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:14.232872 7434 raft_consensus.cc:3060] T 57513cd50186404f9ecc9f729a4c7071 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
W20260502 14:01:14.233021 7233 leader_election.cc:343] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 57513cd50186404f9ecc9f729a4c7071
I20260502 14:01:14.233685 7434 raft_consensus.cc:2468] T 57513cd50186404f9ecc9f729a4c7071 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:14.233989 7233 leader_election.cc:304] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters: c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:14.234193 9018 raft_consensus.cc:2804] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:14.234426 9018 raft_consensus.cc:697] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:01:14.234578 9018 consensus_queue.cc:237] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.261392 8985 raft_consensus.cc:493] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:14.261587 8985 raft_consensus.cc:515] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.262112 8985 leader_election.cc:290] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:14.262740 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bd5e1e8b8b4d5a826be923a2198f00" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:14.262907 7296 raft_consensus.cc:2468] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
W20260502 14:01:14.263080 7371 leader_election.cc:343] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 07bd5e1e8b8b4d5a826be923a2198f00
I20260502 14:01:14.263266 7368 leader_election.cc:304] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters: c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:14.263518 8985 raft_consensus.cc:2804] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:14.263571 8985 raft_consensus.cc:493] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:14.263617 8985 raft_consensus.cc:3060] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:14.264802 8985 raft_consensus.cc:515] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.265270 8985 leader_election.cc:290] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:14.265918 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07bd5e1e8b8b4d5a826be923a2198f00" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
W20260502 14:01:14.266106 7371 leader_election.cc:343] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 07bd5e1e8b8b4d5a826be923a2198f00
I20260502 14:01:14.266146 7296 raft_consensus.cc:3060] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:14.267046 7296 raft_consensus.cc:2468] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:01:14.267436 7368 leader_election.cc:304] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters: c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:14.267812 8985 raft_consensus.cc:2804] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:14.268074 8985 raft_consensus.cc:697] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:01:14.268287 8985 consensus_queue.cc:237] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
W20260502 14:01:14.368468 7511 consensus_peers.cc:597] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 912c143ef13f42529ec28b08615db7dd. This is attempt 1: this message will repeat every 5th retry.
W20260502 14:01:14.391255 7232 connection.cc:570] server connection from 127.0.0.1:33738 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:14.391319 7368 connection.cc:570] server connection from 127.0.0.1:36748 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:14.391535 9147 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:14.157021 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:54036 (local address 127.6.125.67:34739)
0502 14:01:14.167102 (+ 10081us) server_negotiation.cc:207] Beginning negotiation
0502 14:01:14.167107 (+ 5us) server_negotiation.cc:400] Waiting for connection header
0502 14:01:14.167126 (+ 19us) server_negotiation.cc:408] Connection header received
0502 14:01:14.167183 (+ 57us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0502 14:01:14.167186 (+ 3us) server_negotiation.cc:462] Received NEGOTIATE request from client
0502 14:01:14.167242 (+ 56us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0502 14:01:14.167344 (+ 102us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0502 14:01:14.186052 (+ 18708us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0502 14:01:14.186870 (+ 818us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0502 14:01:14.391341 (+204471us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54036: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":9979,"thread_start_us":80,"threads_started":1}
W20260502 14:01:14.391580 7233 connection.cc:570] client connection to 127.6.125.125:46147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:14.393306 9031 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:14.392233 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.125:46147 (local address 127.6.125.65:53375)
0502 14:01:14.392441 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:14.392454 (+ 13us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:14.392529 (+ 75us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:14.393192 (+ 663us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":110}
W20260502 14:01:14.393307 7371 connection.cc:570] client connection to 127.6.125.125:46147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:14.393687 7631 connection.cc:570] client connection to 127.6.125.125:46147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:14.394119 7631 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.6.125.125:46147)
W20260502 14:01:14.394414 7631 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.6.125.125:46147)
W20260502 14:01:14.394496 7631 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.6.125.125:46147)
W20260502 14:01:14.394593 7631 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.6.125.125:46147)
W20260502 14:01:14.433709 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 1: this message will repeat every 5th retry.
W20260502 14:01:14.489675 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 1: this message will repeat every 5th retry.
I20260502 14:01:14.543221 8985 raft_consensus.cc:493] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:14.543359 8985 raft_consensus.cc:515] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.543996 8985 leader_election.cc:290] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:14.544432 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f98e519df42e4ee092cd0931b2abf849" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:14.544579 7296 raft_consensus.cc:2468] T f98e519df42e4ee092cd0931b2abf849 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
W20260502 14:01:14.544706 7371 leader_election.cc:343] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: f98e519df42e4ee092cd0931b2abf849
I20260502 14:01:14.545022 7368 leader_election.cc:304] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters: c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:14.545274 8985 raft_consensus.cc:2804] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:14.545338 8985 raft_consensus.cc:493] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:14.545396 8985 raft_consensus.cc:3060] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:14.546226 8985 raft_consensus.cc:515] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.546625 8985 leader_election.cc:290] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:14.547031 7296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f98e519df42e4ee092cd0931b2abf849" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:01:14.547247 7296 raft_consensus.cc:3060] T f98e519df42e4ee092cd0931b2abf849 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
W20260502 14:01:14.547529 7371 leader_election.cc:343] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: f98e519df42e4ee092cd0931b2abf849
I20260502 14:01:14.548195 7296 raft_consensus.cc:2468] T f98e519df42e4ee092cd0931b2abf849 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:01:14.548527 7368 leader_election.cc:304] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters: c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:14.548777 8985 raft_consensus.cc:2804] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:14.548869 8985 raft_consensus.cc:697] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:01:14.549028 8985 consensus_queue.cc:237] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.621361 9018 consensus_queue.cc:1048] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 14:01:14.626471 7233 consensus_peers.cc:597] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02 -> Peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Couldn't send request to peer c2964848cb1648a4bc2c1d671cc54f62. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57513cd50186404f9ecc9f729a4c7071. This is attempt 1: this message will repeat every 5th retry.
I20260502 14:01:14.640873 9180 raft_consensus.cc:493] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:14.641039 9180 raft_consensus.cc:515] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.641916 9180 leader_election.cc:290] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:14.642553 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd5786e138748adbc73008a40dd6b65" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:14.642717 7434 raft_consensus.cc:2468] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:14.643018 7233 leader_election.cc:304] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
W20260502 14:01:14.643225 7233 leader_election.cc:343] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 0dd5786e138748adbc73008a40dd6b65
I20260502 14:01:14.643414 9180 raft_consensus.cc:2804] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:14.643492 9180 raft_consensus.cc:493] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:14.643538 9180 raft_consensus.cc:3060] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:14.644979 9180 raft_consensus.cc:515] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.645650 9180 leader_election.cc:290] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:14.646077 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dd5786e138748adbc73008a40dd6b65" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:14.646216 7434 raft_consensus.cc:3060] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
W20260502 14:01:14.646410 7233 leader_election.cc:343] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 0dd5786e138748adbc73008a40dd6b65
I20260502 14:01:14.647223 7434 raft_consensus.cc:2468] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:14.647605 7233 leader_election.cc:304] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters: c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:14.647848 9180 raft_consensus.cc:2804] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:14.647960 9180 raft_consensus.cc:697] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:01:14.648126 9180 consensus_queue.cc:237] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.674702 9186 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:14.674835 9186 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:14.676367 9186 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:14.677012 9048 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:14.677892 9048 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:14.678118 9049 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:14.678265 9049 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:14.678498 9186 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 14:01:14.790218 7371 consensus_peers.cc:597] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 -> Peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Couldn't send request to peer c2964848cb1648a4bc2c1d671cc54f62. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07bd5e1e8b8b4d5a826be923a2198f00. This is attempt 1: this message will repeat every 5th retry.
I20260502 14:01:14.832906 8985 consensus_queue.cc:1048] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:14.857638 9190 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:14.857895 9190 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:14.858695 9190 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:14.859874 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:01:14.860091 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:01:14.860193 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:14.860379 9190 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:14.998564 9173 consensus_queue.cc:1048] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 14:01:15.004675 7371 consensus_peers.cc:597] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84 -> Peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Couldn't send request to peer c2964848cb1648a4bc2c1d671cc54f62. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f98e519df42e4ee092cd0931b2abf849. This is attempt 1: this message will repeat every 5th retry.
I20260502 14:01:15.025730 9195 ts_tablet_manager.cc:933] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62: Initiating tablet copy from peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:15.026228 9195 tablet_copy_client.cc:323] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Beginning tablet copy session from remote peer at address 127.6.125.65:37597
I20260502 14:01:15.026887 7317 tablet_copy_service.cc:140] P 4dacd17b49934d2c99a91c60aa672f02: Received BeginTabletCopySession request for tablet 57513cd50186404f9ecc9f729a4c7071 from peer c2964848cb1648a4bc2c1d671cc54f62 ({username='slave'} at 127.6.125.67:57099)
I20260502 14:01:15.027004 7317 tablet_copy_service.cc:161] P 4dacd17b49934d2c99a91c60aa672f02: Beginning new tablet copy session on tablet 57513cd50186404f9ecc9f729a4c7071 from peer c2964848cb1648a4bc2c1d671cc54f62 at {username='slave'} at 127.6.125.67:57099: session id = c2964848cb1648a4bc2c1d671cc54f62-57513cd50186404f9ecc9f729a4c7071
I20260502 14:01:15.027778 7317 tablet_copy_source_session.cc:215] T 57513cd50186404f9ecc9f729a4c7071 P 4dacd17b49934d2c99a91c60aa672f02: Tablet Copy: opened 0 blocks and 1 log segments
I20260502 14:01:15.028873 9195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57513cd50186404f9ecc9f729a4c7071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:15.030752 9195 tablet_copy_client.cc:806] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 0 data blocks...
I20260502 14:01:15.030932 9195 tablet_copy_client.cc:670] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 1 WAL segments...
I20260502 14:01:15.032912 9195 tablet_copy_client.cc:538] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260502 14:01:15.034247 9195 tablet_bootstrap.cc:492] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:15.037324 9195 tablet_bootstrap.cc:492] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:01:15.037629 9195 tablet_bootstrap.cc:492] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap complete.
I20260502 14:01:15.037971 9195 ts_tablet_manager.cc:1403] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.005s
I20260502 14:01:15.038514 9195 raft_consensus.cc:359] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:15.038638 9195 raft_consensus.cc:740] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:15.038784 9195 consensus_queue.cc:260] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:15.039070 9195 ts_tablet_manager.cc:1434] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 14:01:15.039621 7317 tablet_copy_service.cc:342] P 4dacd17b49934d2c99a91c60aa672f02: Request end of tablet copy session c2964848cb1648a4bc2c1d671cc54f62-57513cd50186404f9ecc9f729a4c7071 received from {username='slave'} at 127.6.125.67:57099
I20260502 14:01:15.039710 7317 tablet_copy_service.cc:434] P 4dacd17b49934d2c99a91c60aa672f02: ending tablet copy session c2964848cb1648a4bc2c1d671cc54f62-57513cd50186404f9ecc9f729a4c7071 on tablet 57513cd50186404f9ecc9f729a4c7071 with peer c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:15.120757 9180 consensus_queue.cc:1048] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260502 14:01:15.126480 7233 consensus_peers.cc:597] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 -> Peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Couldn't send request to peer c2964848cb1648a4bc2c1d671cc54f62. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0dd5786e138748adbc73008a40dd6b65. This is attempt 1: this message will repeat every 5th retry.
I20260502 14:01:15.369313 9199 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:15.369475 9199 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:15.369870 9199 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:15.371285 9049 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:15.371459 9048 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:15.371695 9048 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:15.371857 9199 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 14:01:15.407976 9195 ts_tablet_manager.cc:933] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: Initiating tablet copy from peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:15.408339 9195 tablet_copy_client.cc:323] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Beginning tablet copy session from remote peer at address 127.6.125.66:41873
I20260502 14:01:15.408874 7454 tablet_copy_service.cc:140] P 1be1472a04ae46e48d852d66903d9c84: Received BeginTabletCopySession request for tablet 07bd5e1e8b8b4d5a826be923a2198f00 from peer c2964848cb1648a4bc2c1d671cc54f62 ({username='slave'} at 127.6.125.67:38735)
I20260502 14:01:15.408986 7454 tablet_copy_service.cc:161] P 1be1472a04ae46e48d852d66903d9c84: Beginning new tablet copy session on tablet 07bd5e1e8b8b4d5a826be923a2198f00 from peer c2964848cb1648a4bc2c1d671cc54f62 at {username='slave'} at 127.6.125.67:38735: session id = c2964848cb1648a4bc2c1d671cc54f62-07bd5e1e8b8b4d5a826be923a2198f00
I20260502 14:01:15.409942 7454 tablet_copy_source_session.cc:215] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84: Tablet Copy: opened 0 blocks and 1 log segments
I20260502 14:01:15.410913 9195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07bd5e1e8b8b4d5a826be923a2198f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:15.414870 9195 tablet_copy_client.cc:806] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 0 data blocks...
I20260502 14:01:15.415017 9195 tablet_copy_client.cc:670] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 1 WAL segments...
I20260502 14:01:15.416837 9195 tablet_copy_client.cc:538] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260502 14:01:15.418247 9195 tablet_bootstrap.cc:492] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:15.421237 9195 tablet_bootstrap.cc:492] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:01:15.421643 9195 tablet_bootstrap.cc:492] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap complete.
I20260502 14:01:15.421794 9195 ts_tablet_manager.cc:1403] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260502 14:01:15.422302 9195 raft_consensus.cc:359] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:15.422436 9195 raft_consensus.cc:740] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:15.422569 9195 consensus_queue.cc:260] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:15.422832 9195 ts_tablet_manager.cc:1434] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:15.423790 7454 tablet_copy_service.cc:342] P 1be1472a04ae46e48d852d66903d9c84: Request end of tablet copy session c2964848cb1648a4bc2c1d671cc54f62-07bd5e1e8b8b4d5a826be923a2198f00 received from {username='slave'} at 127.6.125.67:38735
I20260502 14:01:15.423885 7454 tablet_copy_service.cc:434] P 1be1472a04ae46e48d852d66903d9c84: ending tablet copy session c2964848cb1648a4bc2c1d671cc54f62-07bd5e1e8b8b4d5a826be923a2198f00 on tablet 07bd5e1e8b8b4d5a826be923a2198f00 with peer c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:15.439734 9195 ts_tablet_manager.cc:933] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62: Initiating tablet copy from peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:15.440124 9195 tablet_copy_client.cc:323] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Beginning tablet copy session from remote peer at address 127.6.125.66:41873
I20260502 14:01:15.440806 7454 tablet_copy_service.cc:140] P 1be1472a04ae46e48d852d66903d9c84: Received BeginTabletCopySession request for tablet f98e519df42e4ee092cd0931b2abf849 from peer c2964848cb1648a4bc2c1d671cc54f62 ({username='slave'} at 127.6.125.67:38735)
I20260502 14:01:15.440939 7454 tablet_copy_service.cc:161] P 1be1472a04ae46e48d852d66903d9c84: Beginning new tablet copy session on tablet f98e519df42e4ee092cd0931b2abf849 from peer c2964848cb1648a4bc2c1d671cc54f62 at {username='slave'} at 127.6.125.67:38735: session id = c2964848cb1648a4bc2c1d671cc54f62-f98e519df42e4ee092cd0931b2abf849
I20260502 14:01:15.441857 7454 tablet_copy_source_session.cc:215] T f98e519df42e4ee092cd0931b2abf849 P 1be1472a04ae46e48d852d66903d9c84: Tablet Copy: opened 0 blocks and 1 log segments
I20260502 14:01:15.442728 9195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f98e519df42e4ee092cd0931b2abf849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:15.444862 9195 tablet_copy_client.cc:806] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 0 data blocks...
I20260502 14:01:15.445153 9195 tablet_copy_client.cc:670] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 1 WAL segments...
I20260502 14:01:15.446777 9195 tablet_copy_client.cc:538] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260502 14:01:15.448694 9195 tablet_bootstrap.cc:492] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:15.453678 9195 tablet_bootstrap.cc:492] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:01:15.453954 9195 tablet_bootstrap.cc:492] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap complete.
I20260502 14:01:15.453996 9183 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:15.454142 9195 ts_tablet_manager.cc:1403] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260502 14:01:15.454203 9183 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:15.454830 9195 raft_consensus.cc:359] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:15.454932 9195 raft_consensus.cc:740] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:15.455027 9183 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:15.455076 9195 consensus_queue.cc:260] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:15.455641 9195 ts_tablet_manager.cc:1434] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.003s
W20260502 14:01:15.456205 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:01:15.456570 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:01:15.456647 7511 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:15.456657 7454 tablet_copy_service.cc:342] P 1be1472a04ae46e48d852d66903d9c84: Request end of tablet copy session c2964848cb1648a4bc2c1d671cc54f62-f98e519df42e4ee092cd0931b2abf849 received from {username='slave'} at 127.6.125.67:38735
I20260502 14:01:15.456751 7454 tablet_copy_service.cc:434] P 1be1472a04ae46e48d852d66903d9c84: ending tablet copy session c2964848cb1648a4bc2c1d671cc54f62-f98e519df42e4ee092cd0931b2abf849 on tablet f98e519df42e4ee092cd0931b2abf849 with peer c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:15.456840 9183 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:15.626858 9190 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:15.627017 9190 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:15.627521 9190 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:15.628279 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:01:15.628396 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:01:15.628469 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:15.628609 9190 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:15.650370 7572 raft_consensus.cc:1217] T 57513cd50186404f9ecc9f729a4c7071 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260502 14:01:15.746809 9195 ts_tablet_manager.cc:933] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: Initiating tablet copy from peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:15.747171 9195 tablet_copy_client.cc:323] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Beginning tablet copy session from remote peer at address 127.6.125.65:37597
I20260502 14:01:15.747678 7317 tablet_copy_service.cc:140] P 4dacd17b49934d2c99a91c60aa672f02: Received BeginTabletCopySession request for tablet 0dd5786e138748adbc73008a40dd6b65 from peer c2964848cb1648a4bc2c1d671cc54f62 ({username='slave'} at 127.6.125.67:57099)
I20260502 14:01:15.747793 7317 tablet_copy_service.cc:161] P 4dacd17b49934d2c99a91c60aa672f02: Beginning new tablet copy session on tablet 0dd5786e138748adbc73008a40dd6b65 from peer c2964848cb1648a4bc2c1d671cc54f62 at {username='slave'} at 127.6.125.67:57099: session id = c2964848cb1648a4bc2c1d671cc54f62-0dd5786e138748adbc73008a40dd6b65
I20260502 14:01:15.751211 7317 tablet_copy_source_session.cc:215] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02: Tablet Copy: opened 0 blocks and 1 log segments
I20260502 14:01:15.752194 9195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd5786e138748adbc73008a40dd6b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:15.754544 9195 tablet_copy_client.cc:806] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 0 data blocks...
I20260502 14:01:15.754696 9195 tablet_copy_client.cc:670] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Starting download of 1 WAL segments...
I20260502 14:01:15.755743 9195 tablet_copy_client.cc:538] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260502 14:01:15.756852 9195 tablet_bootstrap.cc:492] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:15.759696 9195 tablet_bootstrap.cc:492] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:01:15.759974 9195 tablet_bootstrap.cc:492] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap complete.
I20260502 14:01:15.760166 9195 ts_tablet_manager.cc:1403] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260502 14:01:15.760583 9195 raft_consensus.cc:359] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:15.760674 9195 raft_consensus.cc:740] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:15.760784 9195 consensus_queue.cc:260] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:15.761044 9195 ts_tablet_manager.cc:1434] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:15.761976 7317 tablet_copy_service.cc:342] P 4dacd17b49934d2c99a91c60aa672f02: Request end of tablet copy session c2964848cb1648a4bc2c1d671cc54f62-0dd5786e138748adbc73008a40dd6b65 received from {username='slave'} at 127.6.125.67:57099
I20260502 14:01:15.762061 7317 tablet_copy_service.cc:434] P 4dacd17b49934d2c99a91c60aa672f02: ending tablet copy session c2964848cb1648a4bc2c1d671cc54f62-0dd5786e138748adbc73008a40dd6b65 on tablet 0dd5786e138748adbc73008a40dd6b65 with peer c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:15.915005 7572 raft_consensus.cc:1217] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260502 14:01:15.915419 7574 raft_consensus.cc:1217] T f98e519df42e4ee092cd0931b2abf849 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260502 14:01:16.126066 9219 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:16.126202 9219 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:16.126649 9219 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:16.127781 9049 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:16.127862 9048 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:16.127961 9048 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:16.128095 9219 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 14:01:16.149150 7574 raft_consensus.cc:1217] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260502 14:01:16.150060 6645 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu with pid 9029
W20260502 14:01:16.156857 7629 connection.cc:570] client connection to 127.6.125.126:45121 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260502 14:01:16.684631 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--webserver_interface=127.6.125.126
--webserver_port=39397
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 14:01:16.804464 9230 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:01:16.804718 9230 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:01:16.804762 9230 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:01:16.808384 9230 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 14:01:16.808462 9230 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:01:16.808483 9230 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 14:01:16.808501 9230 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 14:01:16.812777 9230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.125.126
--webserver_port=39397
--never_fsync=true
--heap_profile_path=/tmp/kudu.9230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:01:16.813843 9230 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:01:16.814939 9230 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:01:16.821020 9239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:01:16.821033 9236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:01:16.821033 9237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:01:16.821498 9230 server_base.cc:1061] running on GCE node
I20260502 14:01:16.822039 9230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:01:16.823006 9230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:01:16.824285 9230 hybrid_clock.cc:648] HybridClock initialized: now 1777730476824238 us; error 61 us; skew 500 ppm
I20260502 14:01:16.826609 9230 webserver.cc:492] Webserver started at http://127.6.125.126:39397/ using document root <none> and password file <none>
I20260502 14:01:16.827214 9230 fs_manager.cc:362] Metadata directory not provided
I20260502 14:01:16.827277 9230 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:01:16.831158 9230 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:16.833837 9245 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:01:16.835266 9230 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:16.835469 9230 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
uuid: "9d590d630acd4892b59504b1c66c4f2d"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:01:16.836184 9230 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:01:16.856204 9230 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:01:16.856869 9230 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:01:16.857016 9230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:01:16.864704 9297 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.126:45121 every 8 connection(s)
I20260502 14:01:16.864704 9230 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.126:45121
I20260502 14:01:16.865890 9230 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
I20260502 14:01:16.870338 9298 sys_catalog.cc:263] Verifying existing consensus state
I20260502 14:01:16.871973 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 9230
I20260502 14:01:16.872411 9298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap starting.
I20260502 14:01:16.885385 9298 log.cc:826] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Log is configured to *not* fsync() on all Append() calls
I20260502 14:01:16.921814 7481 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:01:16.939741 9298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=110 overwritten=0 applied=110 ignored=0} inserts{seen=66 ignored=0} mutations{seen=99 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:01:16.940181 9298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap complete.
I20260502 14:01:16.942855 9298 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:16.943212 9298 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d590d630acd4892b59504b1c66c4f2d, State: Initialized, Role: FOLLOWER
I20260502 14:01:16.943622 9298 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 110, Last appended: 10.110, Last appended by leader: 110, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:16.944180 9304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:16.944311 9304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:16.944842 9298 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: configured and running, proceeding with master startup.
I20260502 14:01:16.951983 9318 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:16.952167 9318 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: loading cluster ID for follower catalog manager: success
I20260502 14:01:16.955482 9318 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: acquiring CA information for follower catalog manager: success
I20260502 14:01:16.957401 9318 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 14:01:16.956609 9230 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:01:16.958599 9230 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:16.997241 7621 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:01:16.999095 9262 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" instance_seqno: 1777730451630765) as {username='slave'} at 127.6.125.67:59477; Asking this server to re-register.
I20260502 14:01:16.999636 7621 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:17.001250 9262 ts_manager.cc:194] Registered new tserver with Master: c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:17.013396 9183 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:17.013574 9183 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:17.014058 9183 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:17.014837 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:01:17.015130 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:01:17.015228 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:17.015401 9183 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:17.154999 7343 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:01:17.156293 9262 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" instance_seqno: 1777730451168368) as {username='slave'} at 127.6.125.65:57001; Asking this server to re-register.
I20260502 14:01:17.156718 7343 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:17.157879 9262 ts_manager.cc:194] Registered new tserver with Master: 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:17.393867 9304 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:17.394093 9304 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:17.395622 9304 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:17.396152 9249 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:17.397166 9249 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:17.397295 9248 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:17.397401 9248 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:17.397620 9304 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 14:01:17.425976 9262 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" instance_seqno: 1777730451385809) as {username='slave'} at 127.6.125.66:32787; Asking this server to re-register.
I20260502 14:01:17.426564 7481 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:17.427742 9262 ts_manager.cc:194] Registered new tserver with Master: 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:17.567160 8800 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:17.567319 8800 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:17.568066 8800 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:17.568769 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:01:17.568885 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:01:17.568967 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:17.569130 8800 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:17.573388 8800 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:17.573531 8800 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:17.573974 8800 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:17.574978 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:01:17.575148 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:01:17.575237 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:17.575423 8800 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:18.011812 9331 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:18.012085 9331 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:18.012545 9331 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:18.013819 9248 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:18.014012 9249 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:18.014089 9249 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:18.014232 9331 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260502 14:01:18.954308 9345 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:18.954479 9345 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:18.955057 9345 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:18.956781 9249 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:18.956926 9248 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:18.957010 9248 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:18.957381 9345 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260502 14:01:19.272455 7508 consensus_peers.cc:597] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 912c143ef13f42529ec28b08615db7dd. This is attempt 6: this message will repeat every 5th retry.
W20260502 14:01:19.349274 7511 consensus_peers.cc:597] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 912c143ef13f42529ec28b08615db7dd. This is attempt 6: this message will repeat every 5th retry.
W20260502 14:01:19.443499 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 6: this message will repeat every 5th retry.
I20260502 14:01:19.501171 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.125:46147
--webserver_interface=127.6.125.125
--webserver_port=34081
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 14:01:19.625653 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 6: this message will repeat every 5th retry.
W20260502 14:01:19.638334 9353 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:01:19.638604 9353 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:01:19.638664 9353 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:01:19.642896 9353 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 14:01:19.642985 9353 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:01:19.643013 9353 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 14:01:19.643038 9353 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 14:01:19.647775 9353 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.125:46147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.6.125.125
--webserver_port=34081
--never_fsync=true
--heap_profile_path=/tmp/kudu.9353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:01:19.649003 9353 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:01:19.650434 9353 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:01:19.656752 9358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:01:19.656769 9361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:01:19.656814 9353 server_base.cc:1061] running on GCE node
W20260502 14:01:19.656752 9359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:01:19.658157 9353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:01:19.659180 9353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:01:19.660440 9353 hybrid_clock.cc:648] HybridClock initialized: now 1777730479660418 us; error 57 us; skew 500 ppm
I20260502 14:01:19.662906 9353 webserver.cc:492] Webserver started at http://127.6.125.125:34081/ using document root <none> and password file <none>
I20260502 14:01:19.664678 9353 fs_manager.cc:362] Metadata directory not provided
I20260502 14:01:19.665050 9353 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:01:19.669667 9353 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260502 14:01:19.672115 9369 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:01:19.673765 9353 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260502 14:01:19.673915 9353 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
uuid: "78b194cad3b9424395e9a403da13ba80"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:01:19.674407 9353 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:01:19.686178 9353 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:01:19.686887 9353 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:01:19.687054 9353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:01:19.697029 9353 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.125:46147
I20260502 14:01:19.697185 9421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.125:46147 every 8 connection(s)
I20260502 14:01:19.698395 9353 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-1/data/info.pb
I20260502 14:01:19.699165 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 9353
I20260502 14:01:19.703596 9422 sys_catalog.cc:263] Verifying existing consensus state
I20260502 14:01:19.705886 9422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Bootstrap starting.
I20260502 14:01:19.719103 9422 log.cc:826] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Log is configured to *not* fsync() on all Append() calls
I20260502 14:01:19.720959 9426 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:19.721092 9426 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:19.721576 9426 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:19.723295 9248 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:19.796049 9422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Bootstrap replayed 1/1 log segments. Stats: ops{read=110 overwritten=0 applied=110 ignored=0} inserts{seen=66 ignored=0} mutations{seen=99 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:01:19.796541 9422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Bootstrap complete.
I20260502 14:01:19.800685 9422 raft_consensus.cc:359] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 10 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:19.801178 9422 raft_consensus.cc:740] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 10 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78b194cad3b9424395e9a403da13ba80, State: Initialized, Role: FOLLOWER
I20260502 14:01:19.801697 9422 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 110, Last appended: 10.110, Last appended by leader: 110, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:19.802217 9430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:19.802443 9430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:19.802954 9422 sys_catalog.cc:565] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: configured and running, proceeding with master startup.
I20260502 14:01:19.803014 9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d590d630acd4892b59504b1c66c4f2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 110 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80" is_pre_election: true
I20260502 14:01:19.803272 9396 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d590d630acd4892b59504b1c66c4f2d in term 10.
I20260502 14:01:19.803834 9249 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters: a5d257c30a994bfdb03242b10606426f
I20260502 14:01:19.804201 9426 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260502 14:01:19.804262 9426 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:19.804304 9426 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 10 FOLLOWER]: Advancing to term 11
I20260502 14:01:19.806704 9426 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:19.807205 9426 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 election: Requested vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:19.808833 9248 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:19.807801 9396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d590d630acd4892b59504b1c66c4f2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 110 } } ignore_live_leader: false dest_uuid: "78b194cad3b9424395e9a403da13ba80"
I20260502 14:01:19.809194 9396 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 10 FOLLOWER]: Advancing to term 11
I20260502 14:01:19.811702 9396 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d590d630acd4892b59504b1c66c4f2d in term 11.
I20260502 14:01:19.812537 9444 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:19.812605 9444 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: loading cluster ID for follower catalog manager: success
I20260502 14:01:19.812602 9249 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters: a5d257c30a994bfdb03242b10606426f
I20260502 14:01:19.812841 9426 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 11 FOLLOWER]: Leader election won for term 11
I20260502 14:01:19.813112 9426 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 11 LEADER]: Becoming Leader. State: Replica: 9d590d630acd4892b59504b1c66c4f2d, State: Running, Role: LEADER
I20260502 14:01:19.813485 9426 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 10.110, Last appended by leader: 110, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:19.815392 9426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d590d630acd4892b59504b1c66c4f2d. Latest consensus state: current_term: 11 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:19.815567 9426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: LEADER
I20260502 14:01:19.819947 9444 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: acquiring CA information for follower catalog manager: success
I20260502 14:01:19.823858 9451 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 14:01:19.825760 9444 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 14:01:19.825803 9451 catalog_manager.cc:679] Loaded metadata for table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]
I20260502 14:01:19.826228 9451 catalog_manager.cc:679] Loaded metadata for table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]
I20260502 14:01:19.826514 9451 catalog_manager.cc:679] Loaded metadata for table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]
I20260502 14:01:19.827874 9451 catalog_manager.cc:679] Loaded metadata for table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]
I20260502 14:01:19.828225 9451 catalog_manager.cc:679] Loaded metadata for table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]
I20260502 14:01:19.828534 9451 catalog_manager.cc:679] Loaded metadata for table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]
I20260502 14:01:19.828796 9451 catalog_manager.cc:679] Loaded metadata for table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]
I20260502 14:01:19.829031 9451 catalog_manager.cc:679] Loaded metadata for table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]
I20260502 14:01:19.829253 9451 catalog_manager.cc:679] Loaded metadata for table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]
I20260502 14:01:19.829463 9451 catalog_manager.cc:679] Loaded metadata for table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]
I20260502 14:01:19.829668 9451 catalog_manager.cc:679] Loaded metadata for table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]
I20260502 14:01:19.829881 9451 catalog_manager.cc:679] Loaded metadata for table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]
I20260502 14:01:19.831568 9451 tablet_loader.cc:96] loaded metadata for tablet 07bd5e1e8b8b4d5a826be923a2198f00 (table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16])
I20260502 14:01:19.831794 9451 tablet_loader.cc:96] loaded metadata for tablet 098b67380f9440e39aebdd19788e4387 (table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968])
I20260502 14:01:19.831986 9451 tablet_loader.cc:96] loaded metadata for tablet 0dd5786e138748adbc73008a40dd6b65 (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15])
I20260502 14:01:19.830647 9353 master_runner.cc:186] Error getting master registration for 127.6.125.124:43159: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111),
I20260502 14:01:19.832830 9451 tablet_loader.cc:96] loaded metadata for tablet 303cc2525a0d44029b77fbbbf9f12ae1 (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065])
I20260502 14:01:19.832885 9353 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:19.833403 9451 tablet_loader.cc:96] loaded metadata for tablet 531a069eeba64024abd6954b7819c916 (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e])
I20260502 14:01:19.833622 9451 tablet_loader.cc:96] loaded metadata for tablet 54df03f280ce41fda1d06bb316aaa33c (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86])
I20260502 14:01:19.833808 9451 tablet_loader.cc:96] loaded metadata for tablet 57513cd50186404f9ecc9f729a4c7071 (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3])
I20260502 14:01:19.833978 9451 tablet_loader.cc:96] loaded metadata for tablet 579507458b9c43baac056c2a93902876 (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504])
I20260502 14:01:19.834484 9451 tablet_loader.cc:96] loaded metadata for tablet 69d1158bbc864a9998326d5f45fead94 (table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77])
I20260502 14:01:19.835026 9451 tablet_loader.cc:96] loaded metadata for tablet 8b48d38bb19c4730b02922ca28e0c9ff (table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f])
I20260502 14:01:19.835433 9451 tablet_loader.cc:96] loaded metadata for tablet a1e9410673c743bdbe0b0a6cabdbbac3 (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a])
I20260502 14:01:19.836488 9451 tablet_loader.cc:96] loaded metadata for tablet f98e519df42e4ee092cd0931b2abf849 (table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95])
I20260502 14:01:19.836663 9451 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 14:01:19.837354 9451 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:19.837406 9451 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 14:01:19.838145 9451 catalog_manager.cc:1514] Loading token signing keys...
I20260502 14:01:19.838687 9451 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Loaded TSK: 0
I20260502 14:01:19.839279 9451 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 14:01:19.839819 9451 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 14:01:19.840382 9451 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 16
I20260502 14:01:19.884065 7623 heartbeater.cc:344] Connected to a master server at 127.6.125.125:46147
I20260502 14:01:19.885677 7555 tablet_service.cc:1558] Processing DeleteTablet for tablet 912c143ef13f42529ec28b08615db7dd with delete_type TABLET_DATA_DELETED (replaced by tablet f98e519df42e4ee092cd0931b2abf849) from {username='slave'} at 127.0.0.1:51694
I20260502 14:01:19.886044 9455 tablet_replica.cc:333] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:19.886214 9455 raft_consensus.cc:2243] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:19.886209 9386 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" instance_seqno: 1777730451630765) as {username='slave'} at 127.6.125.67:56395; Asking this server to re-register.
I20260502 14:01:19.886456 9455 raft_consensus.cc:2272] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:19.886816 7623 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:19.886902 9455 ts_tablet_manager.cc:1916] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:19.888134 9386 ts_manager.cc:194] Registered new tserver with Master: c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:19.889503 9455 ts_tablet_manager.cc:1929] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:19.889590 9455 log.cc:1199] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/912c143ef13f42529ec28b08615db7dd
I20260502 14:01:19.889854 9455 ts_tablet_manager.cc:1950] T 912c143ef13f42529ec28b08615db7dd P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:19.891321 9249 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet 912c143ef13f42529ec28b08615db7dd (table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]) successfully deleted
I20260502 14:01:19.929811 7483 heartbeater.cc:344] Connected to a master server at 127.6.125.125:46147
I20260502 14:01:19.929968 7483 heartbeater.cc:499] Master 127.6.125.125:46147 was elected leader, sending a full tablet report...
I20260502 14:01:19.931806 9386 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" instance_seqno: 1777730451385809) as {username='slave'} at 127.6.125.66:52489; Asking this server to re-register.
I20260502 14:01:19.932441 7483 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:19.933660 9386 ts_manager.cc:194] Registered new tserver with Master: 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:19.933935 9262 master_service.cc:954] ReplaceTablet: received request to replace tablet a1e9410673c743bdbe0b0a6cabdbbac3 from {username='slave'} at 127.0.0.1:45240
I20260502 14:01:19.934792 9253 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45240:
name: "default.Table_09d33df61a3f4a6480e2fe299421ae1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:19.935410 9254 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45240:
table { table_name: "default.Table_7091f4920e384b37862f746b07e5372f" } modify_external_catalogs: true
I20260502 14:01:19.935550 9254 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45240:
table { table_name: "default.Table_7091f4920e384b37862f746b07e5372f" } modify_external_catalogs: true
I20260502 14:01:19.935743 9255 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45240:
name: "default.Table_5bbf52ba925f45dfae2bee0f411a0316"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:19.936018 9257 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45240:
table { table_name: "default.Table_2866c4520a3d40c4b3c6ca93424e5a0b" } modify_external_catalogs: true
I20260502 14:01:19.936123 9257 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45240:
table { table_name: "default.Table_2866c4520a3d40c4b3c6ca93424e5a0b" } modify_external_catalogs: true
I20260502 14:01:19.936241 9258 master_service.cc:954] ReplaceTablet: received request to replace tablet 0dd5786e138748adbc73008a40dd6b65 from {username='slave'} at 127.0.0.1:45240
I20260502 14:01:19.937237 9259 master_service.cc:954] ReplaceTablet: received request to replace tablet 8b48d38bb19c4730b02922ca28e0c9ff from {username='slave'} at 127.0.0.1:45240
I20260502 14:01:19.937418 9260 master_service.cc:954] ReplaceTablet: received request to replace tablet 0dd5786e138748adbc73008a40dd6b65 from {username='slave'} at 127.0.0.1:45240
I20260502 14:01:19.937641 9261 master_service.cc:954] ReplaceTablet: received request to replace tablet 098b67380f9440e39aebdd19788e4387 from {username='slave'} at 127.0.0.1:45240
I20260502 14:01:19.938684 9256 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45240:
table { table_name: "default.Table_0d20cbe3e06443a39d25177f4abb4de7" } new_table_name: "default.Table_2ce27412960f42de9ef1fc0a234fae45" modify_external_catalogs: true
W20260502 14:01:19.941581 9248 consensus_peers.cc:597] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d -> Peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Couldn't send request to peer a5d257c30a994bfdb03242b10606426f. Status: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260502 14:01:19.942701 9396 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Refusing update from remote peer 9d590d630acd4892b59504b1c66c4f2d: Log matching property violated. Preceding OpId in replica: term: 10 index: 110. Preceding OpId from leader: term: 11 index: 112. (index mismatch)
I20260502 14:01:19.943667 9449 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
F20260502 14:01:19.944960 9317 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 19, previous 19; dumping first 4 out of 10 received events: NotificationEvent(eventId=17, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_5bbf52ba925f45dfae2bee0f411a0316, message={"server":"","servicePrincipal":"","db":"default","table":"table_5bbf52ba925f45dfae2bee0f411a0316","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5bbf52ba925f45dfae2bee0f411a0316\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_5bbf52ba925f45dfae2bee0f411a0316\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5bbf52ba925f45dfae2bee0f411a0316\",\"kudu.table_id\":\"2e0834670d044a0fbe32ffcd671a778b\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=18, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_916010ddd67a42689b76591a02784a0a, message={"server":"","servicePrincipal":"","db":"default","table":"table_916010ddd67a42689b76591a02784a0a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_916010ddd67a42689b76591a02784a0a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_916010ddd67a42689b76591a02784a0a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_916010ddd67a42689b76591a02784a0a\",\"kudu.table_id\":\"337d1a2589374574b8d3b1735b5efe95\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_79e5262b7980424fbe659116c4785e9c, message={"server":"","servicePrincipal":"","db":"default","table":"table_79e5262b7980424fbe659116c4785e9c","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79e5262b7980424fbe659116c4785e9c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730452},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_79e5262b7980424fbe659116c4785e9c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79e5262b7980424fbe659116c4785e9c\",\"kudu.table_id\":\"2b961b00f8804350ade31c5ac13105e3\",\"transient_lastDdlTime\":\"1777730452\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_2866c4520a3d40c4b3c6ca93424e5a0b, message={"server":"","servicePrincipal":"","db":"default","table":"table_2866c4520a3d40c4b3c6ca93424e5a0b","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730453},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2866c4520a3d40c4b3c6ca93424e5a0b\",\"kudu.table_id\":\"a6606215bcc24f789f81868248dcd065\",\"transient_lastDdlTime\":\"1777730453\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f0e5d9c7dcd google::LogMessage::Fail() at ??:0
I20260502 14:01:19.949262 9430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d590d630acd4892b59504b1c66c4f2d. Latest consensus state: current_term: 11 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:19.949409 9430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f0e5d9cbb93 google::LogMessage::SendToLog() at ??:0
I20260502 14:01:19.951864 9426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 11 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:19.952024 9426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: LEADER
I20260502 14:01:19.952598 9430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 11 leader_uuid: "9d590d630acd4892b59504b1c66c4f2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:19.952708 9430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f0e5d9c77cc google::LogMessage::Flush() at ??:0
I20260502 14:01:19.953217 9459 mvcc.cc:204] Tried to move back new op lower bound from 7281584045839880192 to 7281584045319933952. Current Snapshot: MvccSnapshot[applied={T|T < 7281584045833531392}]
@ 0x7f0e5d9c7a11 google::LogMessage::~LogMessage() at ??:0
I20260502 14:01:19.955768 9262 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Sending DeleteTablet for 3 replicas of tablet a1e9410673c743bdbe0b0a6cabdbbac3
I20260502 14:01:19.956231 9258 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Sending DeleteTablet for 3 replicas of tablet 0dd5786e138748adbc73008a40dd6b65
I20260502 14:01:19.956522 9262 catalog_manager.cc:6741] ReplaceTablet: tablet a1e9410673c743bdbe0b0a6cabdbbac3 deleted and replaced by tablet d237adffc92e43a997ca8f359109e70f
I20260502 14:01:19.956820 9260 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45240:
table { table_name: "default.Table_916010ddd67a42689b76591a02784a0a" } modify_external_catalogs: true
I20260502 14:01:19.956961 9260 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45240:
table { table_name: "default.Table_916010ddd67a42689b76591a02784a0a" } modify_external_catalogs: true
I20260502 14:01:19.957715 9262 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45240:
name: "default.Table_438fd981a3264fd58efe636b409acfb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:19.959290 9259 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Sending DeleteTablet for 3 replicas of tablet 8b48d38bb19c4730b02922ca28e0c9ff
I20260502 14:01:19.959661 9259 catalog_manager.cc:6741] ReplaceTablet: tablet 8b48d38bb19c4730b02922ca28e0c9ff deleted and replaced by tablet a88b0ef983604b84820d80b57b1dec2d
I20260502 14:01:19.959939 9259 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45240:
name: "default.Table_fb7cbf56a40a435aafcbd171a7e85925"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:19.960024 7555 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e9410673c743bdbe0b0a6cabdbbac3 with delete_type TABLET_DATA_DELETED (replaced by tablet d237adffc92e43a997ca8f359109e70f) from {username='slave'} at 127.0.0.1:51694
I20260502 14:01:19.960183 7552 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dd5786e138748adbc73008a40dd6b65 with delete_type TABLET_DATA_DELETED (replaced by tablet aee0aa0b9899421e95e37b66b54ee167) from {username='slave'} at 127.0.0.1:51694
I20260502 14:01:19.960249 9455 tablet_replica.cc:333] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:19.960407 9455 raft_consensus.cc:2243] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:19.960529 9455 raft_consensus.cc:2272] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:19.960606 9258 catalog_manager.cc:6741] ReplaceTablet: tablet 0dd5786e138748adbc73008a40dd6b65 deleted and replaced by tablet aee0aa0b9899421e95e37b66b54ee167
I20260502 14:01:19.960821 9258 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45240:
table { table_name: "default.Table_da5e1cd539c94420b562a58316eecee9" } new_table_name: "default.Table_af37839f6f694cdba90e61ecb647fd39" modify_external_catalogs: true
I20260502 14:01:19.960918 9455 ts_tablet_manager.cc:1916] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:19.962795 7552 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b48d38bb19c4730b02922ca28e0c9ff with delete_type TABLET_DATA_DELETED (replaced by tablet a88b0ef983604b84820d80b57b1dec2d) from {username='slave'} at 127.0.0.1:51694
I20260502 14:01:19.959918 9261 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Sending DeleteTablet for 3 replicas of tablet 098b67380f9440e39aebdd19788e4387
I20260502 14:01:19.963276 9261 catalog_manager.cc:6741] ReplaceTablet: tablet 098b67380f9440e39aebdd19788e4387 deleted and replaced by tablet 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:01:19.964435 9455 ts_tablet_manager.cc:1929] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:19.964504 9455 log.cc:1199] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/a1e9410673c743bdbe0b0a6cabdbbac3
I20260502 14:01:19.964744 9455 ts_tablet_manager.cc:1950] T a1e9410673c743bdbe0b0a6cabdbbac3 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:19.964757 7552 tablet_service.cc:1558] Processing DeleteTablet for tablet 098b67380f9440e39aebdd19788e4387 with delete_type TABLET_DATA_DELETED (replaced by tablet 47e4237f6ea34e2e80d90214a1a7da2f) from {username='slave'} at 127.0.0.1:51694
I20260502 14:01:19.965389 9261 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45240:
name: "default.Table_ceee0100290949a6bc0c7926ef8c981e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7f0e62f3b433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260502 14:01:19.967696 9455 tablet_replica.cc:333] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:19.967799 9249 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet a1e9410673c743bdbe0b0a6cabdbbac3 (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]) successfully deleted
I20260502 14:01:19.967841 9455 raft_consensus.cc:2243] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:19.967963 9455 raft_consensus.cc:2272] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:19.968351 9455 ts_tablet_manager.cc:1916] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:19.969041 7552 tablet_service.cc:1511] Processing CreateTablet for tablet d237adffc92e43a997ca8f359109e70f (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:19.969308 7552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d237adffc92e43a997ca8f359109e70f. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f0e62f3a34a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 14:01:19.969709 7555 tablet_service.cc:1511] Processing CreateTablet for tablet aee0aa0b9899421e95e37b66b54ee167 (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:19.969910 7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee0aa0b9899421e95e37b66b54ee167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:19.970628 9455 ts_tablet_manager.cc:1929] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:19.970690 9455 log.cc:1199] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/0dd5786e138748adbc73008a40dd6b65
I20260502 14:01:19.970932 9455 ts_tablet_manager.cc:1950] T 0dd5786e138748adbc73008a40dd6b65 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:19.973243 9249 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet 0dd5786e138748adbc73008a40dd6b65 (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]) successfully deleted
I20260502 14:01:19.973489 9455 tablet_replica.cc:333] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:19.973621 9455 raft_consensus.cc:2243] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:19.973757 9455 raft_consensus.cc:2272] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:19.974403 9455 ts_tablet_manager.cc:1916] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:19.976579 7273 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dd5786e138748adbc73008a40dd6b65 with delete_type TABLET_DATA_DELETED (replaced by tablet aee0aa0b9899421e95e37b66b54ee167) from {username='slave'} at 127.0.0.1:39226
I20260502 14:01:19.976920 7272 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e9410673c743bdbe0b0a6cabdbbac3 with delete_type TABLET_DATA_DELETED (replaced by tablet d237adffc92e43a997ca8f359109e70f) from {username='slave'} at 127.0.0.1:39226
I20260502 14:01:19.977033 7269 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b48d38bb19c4730b02922ca28e0c9ff with delete_type TABLET_DATA_DELETED (replaced by tablet a88b0ef983604b84820d80b57b1dec2d) from {username='slave'} at 127.0.0.1:39226
I20260502 14:01:19.977149 7275 tablet_service.cc:1558] Processing DeleteTablet for tablet 098b67380f9440e39aebdd19788e4387 with delete_type TABLET_DATA_DELETED (replaced by tablet 47e4237f6ea34e2e80d90214a1a7da2f) from {username='slave'} at 127.0.0.1:39226
I20260502 14:01:19.977433 7276 tablet_service.cc:1511] Processing CreateTablet for tablet d237adffc92e43a997ca8f359109e70f (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:19.977716 7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d237adffc92e43a997ca8f359109e70f. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f0e62f39aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 14:01:19.978767 7409 tablet_service.cc:1558] Processing DeleteTablet for tablet a1e9410673c743bdbe0b0a6cabdbbac3 with delete_type TABLET_DATA_DELETED (replaced by tablet d237adffc92e43a997ca8f359109e70f) from {username='slave'} at 127.0.0.1:37220
I20260502 14:01:19.979067 7412 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b48d38bb19c4730b02922ca28e0c9ff with delete_type TABLET_DATA_DELETED (replaced by tablet a88b0ef983604b84820d80b57b1dec2d) from {username='slave'} at 127.0.0.1:37220
I20260502 14:01:19.979187 7414 tablet_service.cc:1558] Processing DeleteTablet for tablet 098b67380f9440e39aebdd19788e4387 with delete_type TABLET_DATA_DELETED (replaced by tablet 47e4237f6ea34e2e80d90214a1a7da2f) from {username='slave'} at 127.0.0.1:37220
I20260502 14:01:19.979458 7410 tablet_service.cc:1511] Processing CreateTablet for tablet d237adffc92e43a997ca8f359109e70f (DEFAULT_TABLE table=default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:19.979715 7410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d237adffc92e43a997ca8f359109e70f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:19.980386 7277 tablet_service.cc:1511] Processing CreateTablet for tablet aee0aa0b9899421e95e37b66b54ee167 (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:19.980630 7277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee0aa0b9899421e95e37b66b54ee167. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f0e62f3f1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x55d28f2f1244 std::function<>::operator()() at ??:0
I20260502 14:01:19.982786 7411 tablet_service.cc:1511] Processing CreateTablet for tablet aee0aa0b9899421e95e37b66b54ee167 (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:19.983069 7413 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dd5786e138748adbc73008a40dd6b65 with delete_type TABLET_DATA_DELETED (replaced by tablet aee0aa0b9899421e95e37b66b54ee167) from {username='slave'} at 127.0.0.1:37220
I20260502 14:01:19.983083 7411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee0aa0b9899421e95e37b66b54ee167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:19.985857 9455 ts_tablet_manager.cc:1929] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:19.985930 9455 log.cc:1199] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/8b48d38bb19c4730b02922ca28e0c9ff
I20260502 14:01:19.986164 9455 ts_tablet_manager.cc:1950] T 8b48d38bb19c4730b02922ca28e0c9ff P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:19.986479 9474 tablet_replica.cc:333] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:19.986634 9474 raft_consensus.cc:2243] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:19.986892 9474 raft_consensus.cc:2272] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:19.987327 9474 ts_tablet_manager.cc:1916] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:19.987711 9477 tablet_bootstrap.cc:492] T d237adffc92e43a997ca8f359109e70f P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:19.988281 7277 tablet_service.cc:1511] Processing CreateTablet for tablet a88b0ef983604b84820d80b57b1dec2d (DEFAULT_TABLE table=default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:19.988538 7277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88b0ef983604b84820d80b57b1dec2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:19.988546 9475 tablet_replica.cc:333] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:19.988679 9475 raft_consensus.cc:2243] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:19.988797 9475 raft_consensus.cc:2272] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:19.989176 9475 ts_tablet_manager.cc:1916] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:19.989588 9474 ts_tablet_manager.cc:1929] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:19.989646 9474 log.cc:1199] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/0dd5786e138748adbc73008a40dd6b65
I20260502 14:01:19.989879 9474 ts_tablet_manager.cc:1950] T 0dd5786e138748adbc73008a40dd6b65 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:19.990203 9473 tablet_bootstrap.cc:492] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:19.991448 9473 tablet_bootstrap.cc:654] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:19.991494 9475 ts_tablet_manager.cc:1929] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:19.991551 9475 log.cc:1199] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/a1e9410673c743bdbe0b0a6cabdbbac3
I20260502 14:01:19.991787 9475 ts_tablet_manager.cc:1950] T a1e9410673c743bdbe0b0a6cabdbbac3 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:19.991922 7411 tablet_service.cc:1511] Processing CreateTablet for tablet a88b0ef983604b84820d80b57b1dec2d (DEFAULT_TABLE table=default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:19.992302 7411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88b0ef983604b84820d80b57b1dec2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:19.992925 9474 tablet_replica.cc:333] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:19.993131 9474 raft_consensus.cc:2243] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:19.993359 9474 raft_consensus.cc:2272] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:19.993793 9474 ts_tablet_manager.cc:1916] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f0e5eecc7ea kudu::Thread::SuperviseThread() at ??:0
I20260502 14:01:19.994967 9246 catalog_manager.cc:5002] TS 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): tablet 0dd5786e138748adbc73008a40dd6b65 (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]) successfully deleted
I20260502 14:01:19.996688 7277 tablet_service.cc:1511] Processing CreateTablet for tablet 47e4237f6ea34e2e80d90214a1a7da2f (DEFAULT_TABLE table=default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:19.996688 7552 tablet_service.cc:1511] Processing CreateTablet for tablet a88b0ef983604b84820d80b57b1dec2d (DEFAULT_TABLE table=default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:19.997076 7552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88b0ef983604b84820d80b57b1dec2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:19.997076 7277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e4237f6ea34e2e80d90214a1a7da2f. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f0e5f8106db start_thread at ??:0
I20260502 14:01:19.998204 9249 catalog_manager.cc:5002] TS c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): tablet 8b48d38bb19c4730b02922ca28e0c9ff (table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]) successfully deleted
I20260502 14:01:19.998572 9476 tablet_bootstrap.cc:492] T d237adffc92e43a997ca8f359109e70f P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
@ 0x7f0e5cb7e61f clone at ??:0
I20260502 14:01:19.999974 9455 tablet_replica.cc:333] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:20.000144 9455 raft_consensus.cc:2243] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:20.000165 9476 tablet_bootstrap.cc:654] T d237adffc92e43a997ca8f359109e70f P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:20.000279 9455 raft_consensus.cc:2272] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:20.000946 9455 ts_tablet_manager.cc:1916] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:20.002065 9476 tablet_bootstrap.cc:492] T d237adffc92e43a997ca8f359109e70f P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:20.002456 9476 ts_tablet_manager.cc:1403] T d237adffc92e43a997ca8f359109e70f P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 14:01:20.002513 9477 tablet_bootstrap.cc:654] T d237adffc92e43a997ca8f359109e70f P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:20.002982 9476 raft_consensus.cc:359] T d237adffc92e43a997ca8f359109e70f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.003135 9476 raft_consensus.cc:385] T d237adffc92e43a997ca8f359109e70f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:20.003163 9476 raft_consensus.cc:740] T d237adffc92e43a997ca8f359109e70f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:20.003291 9476 consensus_queue.cc:260] T d237adffc92e43a997ca8f359109e70f P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.003966 9476 ts_tablet_manager.cc:1434] T d237adffc92e43a997ca8f359109e70f P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260502 14:01:20.004488 9455 ts_tablet_manager.cc:1929] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:20.004576 9455 log.cc:1199] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/098b67380f9440e39aebdd19788e4387
I20260502 14:01:20.004822 9455 ts_tablet_manager.cc:1950] T 098b67380f9440e39aebdd19788e4387 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:20.006397 9475 tablet_replica.cc:333] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:20.006560 9475 raft_consensus.cc:2243] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:20.006789 9475 raft_consensus.cc:2272] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:20.007609 9475 ts_tablet_manager.cc:1916] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:20.010449 9474 ts_tablet_manager.cc:1929] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:20.010689 9474 log.cc:1199] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/a1e9410673c743bdbe0b0a6cabdbbac3
I20260502 14:01:20.011183 9474 ts_tablet_manager.cc:1950] T a1e9410673c743bdbe0b0a6cabdbbac3 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:20.013302 9473 tablet_bootstrap.cc:492] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:20.013419 9473 ts_tablet_manager.cc:1403] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20260502 14:01:20.014003 9476 tablet_bootstrap.cc:492] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:20.013945 9473 raft_consensus.cc:359] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.014073 9473 raft_consensus.cc:385] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:20.014106 9473 raft_consensus.cc:740] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:20.014251 9473 consensus_queue.cc:260] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.014577 9473 ts_tablet_manager.cc:1434] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:20.014777 9473 tablet_bootstrap.cc:492] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:20.015786 9473 tablet_bootstrap.cc:654] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:20.015993 7621 heartbeater.cc:499] Master 127.6.125.126:45121 was elected leader, sending a full tablet report...
I20260502 14:01:20.018249 7345 heartbeater.cc:344] Connected to a master server at 127.6.125.125:46147
I20260502 14:01:20.016965 9476 tablet_bootstrap.cc:654] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:20.018790 9477 tablet_bootstrap.cc:492] T d237adffc92e43a997ca8f359109e70f P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:20.018895 9477 ts_tablet_manager.cc:1403] T d237adffc92e43a997ca8f359109e70f P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
I20260502 14:01:20.019652 9477 raft_consensus.cc:359] T d237adffc92e43a997ca8f359109e70f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.019785 9477 raft_consensus.cc:385] T d237adffc92e43a997ca8f359109e70f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:20.019819 9477 raft_consensus.cc:740] T d237adffc92e43a997ca8f359109e70f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:20.020243 9477 consensus_queue.cc:260] T d237adffc92e43a997ca8f359109e70f P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.020987 9384 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" instance_seqno: 1777730451168368) as {username='slave'} at 127.6.125.65:47299; Asking this server to re-register.
I20260502 14:01:20.021616 7481 heartbeater.cc:499] Master 127.6.125.126:45121 was elected leader, sending a full tablet report...
I20260502 14:01:20.022003 9477 ts_tablet_manager.cc:1434] T d237adffc92e43a997ca8f359109e70f P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260502 14:01:20.023687 9477 tablet_bootstrap.cc:492] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:20.024861 7345 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:20.026047 9477 tablet_bootstrap.cc:654] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:20.028189 9474 tablet_replica.cc:333] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:20.028216 9384 ts_manager.cc:194] Registered new tserver with Master: 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:20.028340 9474 raft_consensus.cc:2243] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:20.028530 9476 tablet_bootstrap.cc:492] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:20.028626 9476 ts_tablet_manager.cc:1403] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260502 14:01:20.028867 9475 ts_tablet_manager.cc:1929] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:20.028935 9475 log.cc:1199] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/8b48d38bb19c4730b02922ca28e0c9ff
I20260502 14:01:20.029178 9475 ts_tablet_manager.cc:1950] T 8b48d38bb19c4730b02922ca28e0c9ff P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:20.029165 9476 raft_consensus.cc:359] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.029268 9476 raft_consensus.cc:385] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:20.029299 9476 raft_consensus.cc:740] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:20.028544 9474 raft_consensus.cc:2272] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:20.029439 9476 consensus_queue.cc:260] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.029713 9476 ts_tablet_manager.cc:1434] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:20.029893 9476 tablet_bootstrap.cc:492] T a88b0ef983604b84820d80b57b1dec2d P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:20.030822 9475 tablet_replica.cc:333] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:20.030954 9476 tablet_bootstrap.cc:654] T a88b0ef983604b84820d80b57b1dec2d P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:20.030953 9475 raft_consensus.cc:2243] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:20.031157 9475 raft_consensus.cc:2272] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:20.031560 9475 ts_tablet_manager.cc:1916] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:20.031654 9474 ts_tablet_manager.cc:1916] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:20.034430 9475 ts_tablet_manager.cc:1929] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:20.034511 9475 log.cc:1199] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/098b67380f9440e39aebdd19788e4387
I20260502 14:01:20.034693 9475 ts_tablet_manager.cc:1950] T 098b67380f9440e39aebdd19788e4387 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:20.034817 9477 tablet_bootstrap.cc:492] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:20.035307 9477 ts_tablet_manager.cc:1403] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.001s
I20260502 14:01:20.036123 9474 ts_tablet_manager.cc:1929] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:20.036206 9474 log.cc:1199] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/8b48d38bb19c4730b02922ca28e0c9ff
I20260502 14:01:20.036423 8800 raft_consensus.cc:493] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:20.036521 8800 raft_consensus.cc:515] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.036522 9477 raft_consensus.cc:359] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.036615 9477 raft_consensus.cc:385] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:20.036688 9477 raft_consensus.cc:740] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:20.037757 9473 tablet_bootstrap.cc:492] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:20.037779 9477 consensus_queue.cc:260] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.038183 9473 ts_tablet_manager.cc:1403] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20260502 14:01:20.038221 8800 leader_election.cc:290] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:20.038471 9474 ts_tablet_manager.cc:1950] T 8b48d38bb19c4730b02922ca28e0c9ff P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:20.038794 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d237adffc92e43a997ca8f359109e70f" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:20.038851 9473 raft_consensus.cc:359] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.038968 9473 raft_consensus.cc:385] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:20.039000 9473 raft_consensus.cc:740] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:20.039042 7434 raft_consensus.cc:2468] T d237adffc92e43a997ca8f359109e70f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:01:20.039124 9473 consensus_queue.cc:260] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.036621 9475 tablet_replica.cc:333] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:20.039378 9475 raft_consensus.cc:2243] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:20.039419 7511 leader_election.cc:304] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:20.039446 9473 ts_tablet_manager.cc:1434] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260502 14:01:20.039695 9190 raft_consensus.cc:2804] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:20.039768 9190 raft_consensus.cc:493] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:20.039804 9190 raft_consensus.cc:3060] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:20.039996 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d237adffc92e43a997ca8f359109e70f" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:20.040360 9474 tablet_replica.cc:333] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:20.040148 7297 raft_consensus.cc:2468] T d237adffc92e43a997ca8f359109e70f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:01:20.040491 9474 raft_consensus.cc:2243] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:20.040613 9474 raft_consensus.cc:2272] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:20.041043 9474 ts_tablet_manager.cc:1916] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:20.042140 9190 raft_consensus.cc:515] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.042531 9190 leader_election.cc:290] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:20.042906 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d237adffc92e43a997ca8f359109e70f" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:20.039714 9473 tablet_bootstrap.cc:492] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:20.042950 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d237adffc92e43a997ca8f359109e70f" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:01:20.043030 7434 raft_consensus.cc:3060] T d237adffc92e43a997ca8f359109e70f P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:20.043044 7297 raft_consensus.cc:3060] T d237adffc92e43a997ca8f359109e70f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:20.043941 7434 raft_consensus.cc:2468] T d237adffc92e43a997ca8f359109e70f P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:01:20.043946 7297 raft_consensus.cc:2468] T d237adffc92e43a997ca8f359109e70f P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:01:20.044332 7511 leader_election.cc:304] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:20.044495 9475 raft_consensus.cc:2272] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:20.044929 8800 raft_consensus.cc:2804] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:20.044924 9475 ts_tablet_manager.cc:1916] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:20.045022 8800 raft_consensus.cc:697] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:01:20.045145 8800 consensus_queue.cc:237] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.046571 9476 tablet_bootstrap.cc:492] T a88b0ef983604b84820d80b57b1dec2d P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:20.046674 9476 ts_tablet_manager.cc:1403] T a88b0ef983604b84820d80b57b1dec2d P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20260502 14:01:20.047374 9475 ts_tablet_manager.cc:1929] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:20.047458 9475 log.cc:1199] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/0dd5786e138748adbc73008a40dd6b65
I20260502 14:01:20.047488 9476 raft_consensus.cc:359] T a88b0ef983604b84820d80b57b1dec2d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.047598 9476 raft_consensus.cc:385] T a88b0ef983604b84820d80b57b1dec2d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:20.047631 9476 raft_consensus.cc:740] T a88b0ef983604b84820d80b57b1dec2d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:20.047832 9475 ts_tablet_manager.cc:1950] T 0dd5786e138748adbc73008a40dd6b65 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:20.048210 9477 ts_tablet_manager.cc:1434] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260502 14:01:20.048425 9477 tablet_bootstrap.cc:492] T a88b0ef983604b84820d80b57b1dec2d P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:20.049731 9477 tablet_bootstrap.cc:654] T a88b0ef983604b84820d80b57b1dec2d P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:20.049872 9476 consensus_queue.cc:260] T a88b0ef983604b84820d80b57b1dec2d P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.051609 9477 tablet_bootstrap.cc:492] T a88b0ef983604b84820d80b57b1dec2d P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:20.051717 9477 ts_tablet_manager.cc:1403] T a88b0ef983604b84820d80b57b1dec2d P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260502 14:01:20.052525 9477 raft_consensus.cc:359] T a88b0ef983604b84820d80b57b1dec2d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.052639 9477 raft_consensus.cc:385] T a88b0ef983604b84820d80b57b1dec2d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:20.052671 9477 raft_consensus.cc:740] T a88b0ef983604b84820d80b57b1dec2d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:20.052927 9474 ts_tablet_manager.cc:1929] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:20.053033 9474 log.cc:1199] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/098b67380f9440e39aebdd19788e4387
I20260502 14:01:20.053253 9473 tablet_bootstrap.cc:654] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:20.053390 9474 ts_tablet_manager.cc:1950] T 098b67380f9440e39aebdd19788e4387 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:20.053529 9476 ts_tablet_manager.cc:1434] T a88b0ef983604b84820d80b57b1dec2d P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260502 14:01:20.054030 9477 consensus_queue.cc:260] T a88b0ef983604b84820d80b57b1dec2d P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.055136 9477 ts_tablet_manager.cc:1434] T a88b0ef983604b84820d80b57b1dec2d P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:20.057098 9473 tablet_bootstrap.cc:492] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:20.057211 9473 ts_tablet_manager.cc:1403] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20260502 14:01:20.057723 9473 raft_consensus.cc:359] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.057833 9473 raft_consensus.cc:385] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:20.057868 9473 raft_consensus.cc:740] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:20.058022 9473 consensus_queue.cc:260] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.059227 9473 ts_tablet_manager.cc:1434] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 14:01:20.059949 9476 tablet_bootstrap.cc:492] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:20.061654 9476 tablet_bootstrap.cc:654] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:20.062953 9476 tablet_bootstrap.cc:492] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:20.063078 9476 ts_tablet_manager.cc:1403] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:20.064005 9476 raft_consensus.cc:359] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.064154 9476 raft_consensus.cc:385] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:20.064188 9476 raft_consensus.cc:740] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:20.064374 9476 consensus_queue.cc:260] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.065771 9476 ts_tablet_manager.cc:1434] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260502 14:01:20.229137 7509 connection.cc:570] server connection from 127.0.0.1:51694 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:20.229137 7232 connection.cc:570] server connection from 127.0.0.1:39226 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:20.229178 7370 connection.cc:570] server connection from 127.0.0.1:37220 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:20.229411 7509 connection.cc:570] client connection to 127.6.125.126:45121 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:20.229435 7231 connection.cc:570] client connection to 127.6.125.126:45121 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:20.229725 7629 connection.cc:570] client connection to 127.6.125.126:45121 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:20.230314 7629 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.6.125.126:45121)
W20260502 14:01:20.230826 7629 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.6.125.126:45121)
W20260502 14:01:20.230942 7629 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.6.125.126:45121)
W20260502 14:01:20.231031 7629 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.6.125.126:45121)
W20260502 14:01:20.232947 9120 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:20.232360 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.126:45121 (local address 127.6.125.67:53655)
0502 14:01:20.232663 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:20.232678 (+ 15us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:20.232764 (+ 86us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:20.232830 (+ 66us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":89}
W20260502 14:01:20.233426 9500 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:20.231731 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.126:45121 (local address 127.0.0.1:45266)
0502 14:01:20.231980 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:20.231993 (+ 13us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:20.232085 (+ 92us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:20.233287 (+ 1202us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":73,"threads_started":1}
W20260502 14:01:20.234222 9364 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:20.230143 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.126:45121 (local address 127.6.125.65:55189)
0502 14:01:20.231510 (+ 1367us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:20.231532 (+ 22us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:20.231635 (+ 103us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:20.234105 (+ 2470us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1175}
W20260502 14:01:20.235989 7369 connection.cc:570] client connection to 127.6.125.126:45121 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260502 14:01:20.246753 9168 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:20.246886 9168 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.247321 9168 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:01:20.248023 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:01:20.248457 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:01:20.248533 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:20.248689 9168 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:01:20.289229 9168 raft_consensus.cc:493] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:20.289397 9168 raft_consensus.cc:515] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.289789 9168 leader_election.cc:290] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:20.290268 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee0aa0b9899421e95e37b66b54ee167" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:20.290292 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee0aa0b9899421e95e37b66b54ee167" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:01:20.290412 7574 raft_consensus.cc:2468] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:20.290416 7434 raft_consensus.cc:2468] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:20.290685 7233 leader_election.cc:304] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:01:20.290858 9168 raft_consensus.cc:2804] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:20.290913 9168 raft_consensus.cc:493] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:20.290940 9168 raft_consensus.cc:3060] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:20.292009 9168 raft_consensus.cc:515] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.292367 9168 leader_election.cc:290] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:20.292846 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee0aa0b9899421e95e37b66b54ee167" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:20.292908 7574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee0aa0b9899421e95e37b66b54ee167" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:01:20.292979 7434 raft_consensus.cc:3060] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:20.293013 7574 raft_consensus.cc:3060] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:20.293884 7574 raft_consensus.cc:2468] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:20.294099 7434 raft_consensus.cc:2468] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:20.294273 7233 leader_election.cc:304] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:20.294538 9168 raft_consensus.cc:2804] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:20.294904 9168 raft_consensus.cc:697] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:01:20.295073 9168 consensus_queue.cc:237] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.302446 8800 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:20.302598 8800 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.303067 8800 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:20.303803 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:01:20.303927 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:01:20.303985 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:20.304122 8800 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:20.309616 8800 raft_consensus.cc:493] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:20.309744 8800 raft_consensus.cc:515] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.310235 8800 leader_election.cc:290] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:20.310659 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b0ef983604b84820d80b57b1dec2d" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:20.310690 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b0ef983604b84820d80b57b1dec2d" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:20.310784 7297 raft_consensus.cc:2468] T a88b0ef983604b84820d80b57b1dec2d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:01:20.310900 7434 raft_consensus.cc:2468] T a88b0ef983604b84820d80b57b1dec2d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
I20260502 14:01:20.311200 7508 leader_election.cc:304] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:20.311370 8800 raft_consensus.cc:2804] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:20.311434 8800 raft_consensus.cc:493] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:20.311467 8800 raft_consensus.cc:3060] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:20.312354 8800 raft_consensus.cc:515] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.312876 8800 leader_election.cc:290] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:20.313288 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b0ef983604b84820d80b57b1dec2d" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:01:20.313390 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88b0ef983604b84820d80b57b1dec2d" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:20.313446 7297 raft_consensus.cc:3060] T a88b0ef983604b84820d80b57b1dec2d P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:20.313522 7434 raft_consensus.cc:3060] T a88b0ef983604b84820d80b57b1dec2d P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:20.314846 7434 raft_consensus.cc:2468] T a88b0ef983604b84820d80b57b1dec2d P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:01:20.314846 7297 raft_consensus.cc:2468] T a88b0ef983604b84820d80b57b1dec2d P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:01:20.315408 7511 leader_election.cc:304] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:20.315650 8800 raft_consensus.cc:2804] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:20.315747 8800 raft_consensus.cc:697] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:01:20.315959 8800 consensus_queue.cc:237] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.485232 9505 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:01:20.485394 9505 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:20.486840 9505 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:20.487419 9371 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
W20260502 14:01:20.488169 9371 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
W20260502 14:01:20.488270 9372 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:20.488404 9372 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80; no voters: 9d590d630acd4892b59504b1c66c4f2d, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:20.488740 9505 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260502 14:01:20.589968 8800 consensus_queue.cc:1048] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:20.594864 8800 consensus_queue.cc:1048] T d237adffc92e43a997ca8f359109e70f P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:20.719296 9183 consensus_queue.cc:1048] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:20.723503 8800 consensus_queue.cc:1048] T a88b0ef983604b84820d80b57b1dec2d P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:20.729651 9168 consensus_queue.cc:1048] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:20.734256 9168 consensus_queue.cc:1048] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:20.794593 9183 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:20.794760 9183 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:20.795310 9183 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:20.796242 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:01:20.796366 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:01:20.796514 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:20.796854 9183 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:21.132494 9522 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:01:21.132634 9522 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:21.133160 9522 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:21.134744 9371 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
W20260502 14:01:21.134857 9372 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:21.134920 9372 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80; no voters: 9d590d630acd4892b59504b1c66c4f2d, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:21.135167 9522 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260502 14:01:21.818408 9533 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:01:21.818555 9533 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:21.818974 9533 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:21.820520 9372 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:21.820631 9371 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121): Network error: Client connection negotiation failed: client connection to 127.6.125.126:45121: connect: Connection refused (error 111)
I20260502 14:01:21.820891 9371 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80; no voters: 9d590d630acd4892b59504b1c66c4f2d, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:21.821166 9533 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260502 14:01:22.147118 9168 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:22.147326 9168 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:22.147961 9168 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:01:22.148828 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:01:22.148957 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:01:22.149009 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:22.149243 9168 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:01:22.406843 6645 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
/tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--webserver_interface=127.6.125.126
--webserver_port=39397
--builtin_ntp_servers=127.6.125.84:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260502 14:01:22.546995 9544 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260502 14:01:22.547356 9544 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260502 14:01:22.547431 9544 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260502 14:01:22.551573 9544 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260502 14:01:22.551658 9544 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260502 14:01:22.551678 9544 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260502 14:01:22.551695 9544 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260502 14:01:22.557545 9544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.125.84:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:42369
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.125.126:45121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.125.126
--webserver_port=39397
--never_fsync=true
--heap_profile_path=/tmp/kudu.9544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
build type DEBUG
built by None at 02 May 2026 13:43:15 UTC on bdcb31816ec0
build id 11708
I20260502 14:01:22.559477 9544 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260502 14:01:22.562290 9544 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260502 14:01:22.568996 9549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:01:22.569418 9552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260502 14:01:22.569555 9550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260502 14:01:22.570461 9544 server_base.cc:1061] running on GCE node
I20260502 14:01:22.571203 9544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260502 14:01:22.572849 9544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260502 14:01:22.576370 9544 hybrid_clock.cc:648] HybridClock initialized: now 1777730482576199 us; error 124 us; skew 500 ppm
I20260502 14:01:22.579201 9544 webserver.cc:492] Webserver started at http://127.6.125.126:39397/ using document root <none> and password file <none>
I20260502 14:01:22.579869 9544 fs_manager.cc:362] Metadata directory not provided
I20260502 14:01:22.579975 9544 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260502 14:01:22.583842 9544 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.000s sys 0.002s
I20260502 14:01:22.587500 9558 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260502 14:01:22.589551 9544 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260502 14:01:22.589725 9544 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data,/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
uuid: "9d590d630acd4892b59504b1c66c4f2d"
format_stamp: "Formatted at 2026-05-02 14:00:50 on dist-test-slave-6vpk"
I20260502 14:01:22.590281 9544 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260502 14:01:22.606554 9544 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260502 14:01:22.607348 9544 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260502 14:01:22.607532 9544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260502 14:01:22.615916 9544 rpc_server.cc:307] RPC server started. Bound to: 127.6.125.126:45121
I20260502 14:01:22.615919 9610 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.125.126:45121 every 8 connection(s)
I20260502 14:01:22.617828 9544 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/master-0/data/info.pb
I20260502 14:01:22.622153 9611 sys_catalog.cc:263] Verifying existing consensus state
I20260502 14:01:22.623943 9611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap starting.
I20260502 14:01:22.626667 6645 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskjX7ZjU/build/debug/bin/kudu as pid 9544
I20260502 14:01:22.638622 9611 log.cc:826] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Log is configured to *not* fsync() on all Append() calls
I20260502 14:01:22.694499 7343 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:01:22.705399 9611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=117 overwritten=0 applied=117 ignored=0} inserts{seen=70 ignored=0} mutations{seen=107 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260502 14:01:22.705811 9611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: Bootstrap complete.
I20260502 14:01:22.708518 9611 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 11 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:22.708887 9611 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 11 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d590d630acd4892b59504b1c66c4f2d, State: Initialized, Role: FOLLOWER
I20260502 14:01:22.709548 9611 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 117, Last appended: 11.117, Last appended by leader: 117, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:22.710054 9617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:22.710183 9617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:22.710726 9611 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: configured and running, proceeding with master startup.
I20260502 14:01:22.718118 9631 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:22.718207 9631 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: loading cluster ID for follower catalog manager: success
I20260502 14:01:22.721078 9631 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: acquiring CA information for follower catalog manager: success
I20260502 14:01:22.724434 9631 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260502 14:01:22.731509 9544 master_runner.cc:186] Error getting master registration for 127.6.125.124:43159: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111),
I20260502 14:01:22.733618 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:22.739240 7621 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:01:22.739391 7621 heartbeater.cc:499] Master 127.6.125.126:45121 was elected leader, sending a full tablet report...
I20260502 14:01:22.741530 9575 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" instance_seqno: 1777730451630765) as {username='slave'} at 127.6.125.67:57807; Asking this server to re-register.
I20260502 14:01:22.743230 7621 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:22.744668 7481 heartbeater.cc:344] Connected to a master server at 127.6.125.126:45121
I20260502 14:01:22.744690 9575 ts_manager.cc:194] Registered new tserver with Master: c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:22.744807 7481 heartbeater.cc:499] Master 127.6.125.126:45121 was elected leader, sending a full tablet report...
I20260502 14:01:22.746709 9575 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" instance_seqno: 1777730451385809) as {username='slave'} at 127.6.125.66:54339; Asking this server to re-register.
I20260502 14:01:22.747258 7481 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:22.748852 9575 ts_manager.cc:194] Registered new tserver with Master: 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
I20260502 14:01:23.198150 9575 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" instance_seqno: 1777730451168368) as {username='slave'} at 127.6.125.65:33735; Asking this server to re-register.
I20260502 14:01:23.198630 7343 heartbeater.cc:461] Registering TS with master...
I20260502 14:01:23.199697 9575 ts_manager.cc:194] Registered new tserver with Master: 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:23.231638 9638 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:01:23.231781 9638 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:23.232286 9638 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:23.233907 9372 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:23.237128 9585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 12 candidate_status { last_received { term: 11 index: 117 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d" is_pre_election: true
I20260502 14:01:23.237728 9585 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78b194cad3b9424395e9a403da13ba80 in term 11.
I20260502 14:01:23.238277 9371 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters: a5d257c30a994bfdb03242b10606426f
I20260502 14:01:23.238554 9638 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260502 14:01:23.238620 9638 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d590d630acd4892b59504b1c66c4f2d)
I20260502 14:01:23.238668 9638 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 11 FOLLOWER]: Advancing to term 12
I20260502 14:01:23.239857 9638 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:23.240370 9638 leader_election.cc:290] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 election: Requested vote from peers 9d590d630acd4892b59504b1c66c4f2d (127.6.125.126:45121), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:01:23.240873 9585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "78b194cad3b9424395e9a403da13ba80" candidate_term: 12 candidate_status { last_received { term: 11 index: 117 } } ignore_live_leader: false dest_uuid: "9d590d630acd4892b59504b1c66c4f2d"
I20260502 14:01:23.241045 9585 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 11 FOLLOWER]: Advancing to term 12
W20260502 14:01:23.241907 9372 leader_election.cc:336] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:23.243386 9585 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78b194cad3b9424395e9a403da13ba80 in term 12.
I20260502 14:01:23.243939 9371 leader_election.cc:304] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 78b194cad3b9424395e9a403da13ba80, 9d590d630acd4892b59504b1c66c4f2d; no voters: a5d257c30a994bfdb03242b10606426f
I20260502 14:01:23.244267 9638 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 12 FOLLOWER]: Leader election won for term 12
I20260502 14:01:23.244498 9638 raft_consensus.cc:697] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [term 12 LEADER]: Becoming Leader. State: Replica: 78b194cad3b9424395e9a403da13ba80, State: Running, Role: LEADER
I20260502 14:01:23.244827 9638 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 11.117, Last appended by leader: 117, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:23.245982 9642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78b194cad3b9424395e9a403da13ba80. Latest consensus state: current_term: 12 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:23.246109 9642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: LEADER
I20260502 14:01:23.246500 9644 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260502 14:01:23.248382 9644 catalog_manager.cc:679] Loaded metadata for table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3]
I20260502 14:01:23.248701 9644 catalog_manager.cc:679] Loaded metadata for table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e]
I20260502 14:01:23.248921 9644 catalog_manager.cc:679] Loaded metadata for table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968]
I20260502 14:01:23.249158 9644 catalog_manager.cc:679] Loaded metadata for table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77]
I20260502 14:01:23.249372 9644 catalog_manager.cc:679] Loaded metadata for table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95]
I20260502 14:01:23.249570 9644 catalog_manager.cc:679] Loaded metadata for table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]
I20260502 14:01:23.249780 9644 catalog_manager.cc:679] Loaded metadata for table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a]
I20260502 14:01:23.250007 9644 catalog_manager.cc:679] Loaded metadata for table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86]
I20260502 14:01:23.250247 9644 catalog_manager.cc:679] Loaded metadata for table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504]
I20260502 14:01:23.250486 9644 catalog_manager.cc:679] Loaded metadata for table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]
I20260502 14:01:23.250712 9644 catalog_manager.cc:679] Loaded metadata for table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f]
I20260502 14:01:23.250948 9644 catalog_manager.cc:679] Loaded metadata for table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]
I20260502 14:01:23.252585 9644 tablet_loader.cc:96] loaded metadata for tablet 07bd5e1e8b8b4d5a826be923a2198f00 (table default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16])
I20260502 14:01:23.253454 9644 tablet_loader.cc:96] loaded metadata for tablet 303cc2525a0d44029b77fbbbf9f12ae1 (table default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065])
I20260502 14:01:23.253863 9644 tablet_loader.cc:96] loaded metadata for tablet 47e4237f6ea34e2e80d90214a1a7da2f (table default.table_7091f4920e384b37862f746b07e5372f [id=2ecff91a2da84cc0948f5de7e361f968])
I20260502 14:01:23.254106 9644 tablet_loader.cc:96] loaded metadata for tablet 531a069eeba64024abd6954b7819c916 (table default.table_f0b8f5be35da4f878de056348eefee40 [id=2e16fc53645e4ac09e94393928628f3e])
I20260502 14:01:23.254258 9644 tablet_loader.cc:96] loaded metadata for tablet 54df03f280ce41fda1d06bb316aaa33c (table default.table_0d20cbe3e06443a39d25177f4abb4de7 [id=5f7ce7415f6e4ee19261effe9db10f86])
I20260502 14:01:23.254423 9644 tablet_loader.cc:96] loaded metadata for tablet 57513cd50186404f9ecc9f729a4c7071 (table default.table_79e5262b7980424fbe659116c4785e9c [id=2b961b00f8804350ade31c5ac13105e3])
I20260502 14:01:23.254602 9644 tablet_loader.cc:96] loaded metadata for tablet 579507458b9c43baac056c2a93902876 (table default.table_9c2adeda8ca24651b8be47c058c64d23 [id=a4faee50852b47da98cc7526f3f29504])
I20260502 14:01:23.255290 9644 tablet_loader.cc:96] loaded metadata for tablet 69d1158bbc864a9998326d5f45fead94 (table default.table_0912854d0fb44cf69bf731fbb257be24 [id=321f6823ca254da0a1df577c65103d77])
I20260502 14:01:23.256249 9644 tablet_loader.cc:96] loaded metadata for tablet a88b0ef983604b84820d80b57b1dec2d (table default.table_2f350d07bc2340ceaf7259efed2efac2 [id=d9610ffe3e2c4c75b5f7a79ae6269e4f])
I20260502 14:01:23.256527 9644 tablet_loader.cc:96] loaded metadata for tablet aee0aa0b9899421e95e37b66b54ee167 (table default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15])
I20260502 14:01:23.257172 9644 tablet_loader.cc:96] loaded metadata for tablet d237adffc92e43a997ca8f359109e70f (table default.table_e209f5be8519489e973e7a888ad911ee [id=5827a943881f4a9c817c1de3bfea409a])
I20260502 14:01:23.257788 9644 tablet_loader.cc:96] loaded metadata for tablet f98e519df42e4ee092cd0931b2abf849 (table default.table_916010ddd67a42689b76591a02784a0a [id=337d1a2589374574b8d3b1735b5efe95])
I20260502 14:01:23.257951 9644 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260502 14:01:23.258613 9644 catalog_manager.cc:1269] Loaded cluster ID: c285f605dabf42b592316f36adee5f8a
I20260502 14:01:23.258659 9644 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260502 14:01:23.259861 9644 catalog_manager.cc:1514] Loading token signing keys...
I20260502 14:01:23.260820 9644 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Loaded TSK: 0
I20260502 14:01:23.261757 9644 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260502 14:01:23.262468 9644 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260502 14:01:23.262990 9644 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 16
I20260502 14:01:23.277369 9386 master_service.cc:954] ReplaceTablet: received request to replace tablet 303cc2525a0d44029b77fbbbf9f12ae1 from {username='slave'} at 127.0.0.1:52504
I20260502 14:01:23.277462 9384 master_service.cc:954] ReplaceTablet: received request to replace tablet aee0aa0b9899421e95e37b66b54ee167 from {username='slave'} at 127.0.0.1:52504
I20260502 14:01:23.277731 9380 master_service.cc:954] ReplaceTablet: received request to replace tablet aee0aa0b9899421e95e37b66b54ee167 from {username='slave'} at 127.0.0.1:52504
I20260502 14:01:23.277894 9385 master_service.cc:954] ReplaceTablet: received request to replace tablet 07bd5e1e8b8b4d5a826be923a2198f00 from {username='slave'} at 127.0.0.1:52504
I20260502 14:01:23.278021 9382 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52504:
table { table_name: "default.Table_f0b8f5be35da4f878de056348eefee40" } new_table_name: "default.Table_e199b1aa26354ce2b3578613f359d8c3" modify_external_catalogs: true
I20260502 14:01:23.278340 9383 master_service.cc:954] ReplaceTablet: received request to replace tablet 303cc2525a0d44029b77fbbbf9f12ae1 from {username='slave'} at 127.0.0.1:52504
I20260502 14:01:23.278694 9379 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52504:
table { table_name: "default.Table_9c2adeda8ca24651b8be47c058c64d23" } new_table_name: "default.Table_a7e4568b673f4d569bb4a906a15952bf" modify_external_catalogs: true
I20260502 14:01:23.279021 9378 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52504:
name: "default.Table_116f97550c144f10bc14cc8c29c1d169"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:23.279347 9377 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52504:
table { table_name: "default.Table_0912854d0fb44cf69bf731fbb257be24" } modify_external_catalogs: true
I20260502 14:01:23.279461 9377 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52504:
table { table_name: "default.Table_0912854d0fb44cf69bf731fbb257be24" } modify_external_catalogs: true
I20260502 14:01:23.279609 9381 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52504:
table { table_name: "default.Table_d303c0450b934f2bb0f8ab01b92f2e67" } new_table_name: "default.Table_18b522eec8284015942366c63506ec7e" modify_external_catalogs: true
I20260502 14:01:23.281502 9585 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Refusing update from remote peer 78b194cad3b9424395e9a403da13ba80: Log matching property violated. Preceding OpId in replica: term: 11 index: 117. Preceding OpId from leader: term: 12 index: 119. (index mismatch)
W20260502 14:01:23.281899 9372 consensus_peers.cc:597] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 -> Peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Couldn't send request to peer a5d257c30a994bfdb03242b10606426f. Status: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260502 14:01:23.282119 9642 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
F20260502 14:01:23.285272 9443 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 19, previous 19; dumping first 4 out of 10 received events: NotificationEvent(eventId=17, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_5bbf52ba925f45dfae2bee0f411a0316, message={"server":"","servicePrincipal":"","db":"default","table":"table_5bbf52ba925f45dfae2bee0f411a0316","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_5bbf52ba925f45dfae2bee0f411a0316\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_5bbf52ba925f45dfae2bee0f411a0316\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_5bbf52ba925f45dfae2bee0f411a0316\",\"kudu.table_id\":\"2e0834670d044a0fbe32ffcd671a778b\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=18, eventTime=1777730454, eventType=CREATE_TABLE, dbName=default, tableName=table_916010ddd67a42689b76591a02784a0a, message={"server":"","servicePrincipal":"","db":"default","table":"table_916010ddd67a42689b76591a02784a0a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_916010ddd67a42689b76591a02784a0a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730454},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_916010ddd67a42689b76591a02784a0a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_916010ddd67a42689b76591a02784a0a\",\"kudu.table_id\":\"337d1a2589374574b8d3b1735b5efe95\",\"transient_lastDdlTime\":\"1777730454\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730454,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_79e5262b7980424fbe659116c4785e9c, message={"server":"","servicePrincipal":"","db":"default","table":"table_79e5262b7980424fbe659116c4785e9c","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_79e5262b7980424fbe659116c4785e9c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730452},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_79e5262b7980424fbe659116c4785e9c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_79e5262b7980424fbe659116c4785e9c\",\"kudu.table_id\":\"2b961b00f8804350ade31c5ac13105e3\",\"transient_lastDdlTime\":\"1777730452\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=19, eventTime=1777730455, eventType=DROP_TABLE, dbName=default, tableName=table_2866c4520a3d40c4b3c6ca93424e5a0b, message={"server":"","servicePrincipal":"","db":"default","table":"table_2866c4520a3d40c4b3c6ca93424e5a0b","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777730453},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/warehouse/table_2866c4520a3d40c4b3c6ca93424e5a0b\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2866c4520a3d40c4b3c6ca93424e5a0b\",\"kudu.table_id\":\"a6606215bcc24f789f81868248dcd065\",\"transient_lastDdlTime\":\"1777730453\",\"comment\":\"\",\"kudu.master_addresses\":\"127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"c285f605dabf42b592316f36adee5f8a\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777730455}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260502 14:01:23.286341 9646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78b194cad3b9424395e9a403da13ba80. Latest consensus state: current_term: 12 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:23.286470 9646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:23.288915 9638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 12 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:23.289104 9638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80 [sys.catalog]: This master's current role is: LEADER
I20260502 14:01:23.289716 9646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 12 leader_uuid: "78b194cad3b9424395e9a403da13ba80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } } }
I20260502 14:01:23.289837 9646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [sys.catalog]: This master's current role is: FOLLOWER
I20260502 14:01:23.289865 9647 mvcc.cc:204] Tried to move back new op lower bound from 7281584059518418944 to 7281584059373514752. Current Snapshot: MvccSnapshot[applied={T|T < 7281584059513536512}]
@ 0x7f02cf5a7dcd google::LogMessage::Fail() at ??:0
@ 0x7f02cf5abb93 google::LogMessage::SendToLog() at ??:0
I20260502 14:01:23.292016 9386 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet 303cc2525a0d44029b77fbbbf9f12ae1
I20260502 14:01:23.292311 9385 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet 07bd5e1e8b8b4d5a826be923a2198f00
I20260502 14:01:23.292481 9380 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52504:
name: "default.Table_afe9c083ff0b4d1487651533fee05e6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:23.292584 9383 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52504:
name: "default.Table_c3fa81d759a04db897e93aa688729318"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:23.292016 9384 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 78b194cad3b9424395e9a403da13ba80: Sending DeleteTablet for 3 replicas of tablet aee0aa0b9899421e95e37b66b54ee167
@ 0x7f02cf5a77cc google::LogMessage::Flush() at ??:0
I20260502 14:01:23.294816 9384 catalog_manager.cc:6741] ReplaceTablet: tablet aee0aa0b9899421e95e37b66b54ee167 deleted and replaced by tablet 1b64f2f3a9d74673a89ca35f9da8243c
I20260502 14:01:23.295333 9384 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52504:
name: "default.Table_3803b7a44d4847adabbc5a04821f0382"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260502 14:01:23.295617 9385 catalog_manager.cc:6741] ReplaceTablet: tablet 07bd5e1e8b8b4d5a826be923a2198f00 deleted and replaced by tablet 546a9fb9f532456d8bc2d85b92840ecf
I20260502 14:01:23.295732 9386 catalog_manager.cc:6741] ReplaceTablet: tablet 303cc2525a0d44029b77fbbbf9f12ae1 deleted and replaced by tablet 5d76651ec6334d63ba3e36f27087958c
I20260502 14:01:23.295815 9385 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52504:
table { table_name: "default.Table_e209f5be8519489e973e7a888ad911ee" } modify_external_catalogs: true
I20260502 14:01:23.295964 9385 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52504:
table { table_name: "default.Table_e209f5be8519489e973e7a888ad911ee" } modify_external_catalogs: true
I20260502 14:01:23.296089 9386 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52504:
table { table_name: "default.Table_2866c4520a3d40c4b3c6ca93424e5a0b" } modify_external_catalogs: true
I20260502 14:01:23.296211 9386 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52504:
table { table_name: "default.Table_2866c4520a3d40c4b3c6ca93424e5a0b" } modify_external_catalogs: true
@ 0x7f02cf5a7a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7f02d4b1b433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f02d4b1a34a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260502 14:01:23.307588 7411 tablet_service.cc:1558] Processing DeleteTablet for tablet 07bd5e1e8b8b4d5a826be923a2198f00 with delete_type TABLET_DATA_DELETED (replaced by tablet 546a9fb9f532456d8bc2d85b92840ecf) from {username='slave'} at 127.0.0.1:37230
I20260502 14:01:23.307868 7413 tablet_service.cc:1558] Processing DeleteTablet for tablet aee0aa0b9899421e95e37b66b54ee167 with delete_type TABLET_DATA_DELETED (replaced by tablet 1b64f2f3a9d74673a89ca35f9da8243c) from {username='slave'} at 127.0.0.1:37230
I20260502 14:01:23.308404 7410 tablet_service.cc:1558] Processing DeleteTablet for tablet 303cc2525a0d44029b77fbbbf9f12ae1 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d76651ec6334d63ba3e36f27087958c) from {username='slave'} at 127.0.0.1:37230
I20260502 14:01:23.309136 7414 tablet_service.cc:1511] Processing CreateTablet for tablet 546a9fb9f532456d8bc2d85b92840ecf (DEFAULT_TABLE table=default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:23.309566 7414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 546a9fb9f532456d8bc2d85b92840ecf. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f02d4b19aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260502 14:01:23.311548 7277 tablet_service.cc:1558] Processing DeleteTablet for tablet 303cc2525a0d44029b77fbbbf9f12ae1 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d76651ec6334d63ba3e36f27087958c) from {username='slave'} at 127.0.0.1:39228
I20260502 14:01:23.311822 7276 tablet_service.cc:1558] Processing DeleteTablet for tablet aee0aa0b9899421e95e37b66b54ee167 with delete_type TABLET_DATA_DELETED (replaced by tablet 1b64f2f3a9d74673a89ca35f9da8243c) from {username='slave'} at 127.0.0.1:39228
I20260502 14:01:23.312188 7269 tablet_service.cc:1511] Processing CreateTablet for tablet 546a9fb9f532456d8bc2d85b92840ecf (DEFAULT_TABLE table=default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:23.312244 7412 tablet_service.cc:1511] Processing CreateTablet for tablet 5d76651ec6334d63ba3e36f27087958c (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:23.312608 7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 546a9fb9f532456d8bc2d85b92840ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:23.312634 7412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d76651ec6334d63ba3e36f27087958c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:23.312960 7552 tablet_service.cc:1558] Processing DeleteTablet for tablet aee0aa0b9899421e95e37b66b54ee167 with delete_type TABLET_DATA_DELETED (replaced by tablet 1b64f2f3a9d74673a89ca35f9da8243c) from {username='slave'} at 127.0.0.1:51706
I20260502 14:01:23.313241 7555 tablet_service.cc:1558] Processing DeleteTablet for tablet 07bd5e1e8b8b4d5a826be923a2198f00 with delete_type TABLET_DATA_DELETED (replaced by tablet 546a9fb9f532456d8bc2d85b92840ecf) from {username='slave'} at 127.0.0.1:51706
I20260502 14:01:23.313344 7549 tablet_service.cc:1558] Processing DeleteTablet for tablet 303cc2525a0d44029b77fbbbf9f12ae1 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d76651ec6334d63ba3e36f27087958c) from {username='slave'} at 127.0.0.1:51706
I20260502 14:01:23.313592 7550 tablet_service.cc:1511] Processing CreateTablet for tablet 5d76651ec6334d63ba3e36f27087958c (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:23.313851 7550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d76651ec6334d63ba3e36f27087958c. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f02d4b1f1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x563b774bc244 std::function<>::operator()() at ??:0
I20260502 14:01:23.315191 7409 tablet_service.cc:1511] Processing CreateTablet for tablet 1b64f2f3a9d74673a89ca35f9da8243c (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:23.315191 7272 tablet_service.cc:1511] Processing CreateTablet for tablet 5d76651ec6334d63ba3e36f27087958c (DEFAULT_TABLE table=default.table_2866c4520a3d40c4b3c6ca93424e5a0b [id=a6606215bcc24f789f81868248dcd065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:23.315434 7409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b64f2f3a9d74673a89ca35f9da8243c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:23.315434 7272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d76651ec6334d63ba3e36f27087958c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:23.316772 7553 tablet_service.cc:1511] Processing CreateTablet for tablet 1b64f2f3a9d74673a89ca35f9da8243c (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:23.317055 7553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b64f2f3a9d74673a89ca35f9da8243c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:23.318722 7275 tablet_service.cc:1558] Processing DeleteTablet for tablet 07bd5e1e8b8b4d5a826be923a2198f00 with delete_type TABLET_DATA_DELETED (replaced by tablet 546a9fb9f532456d8bc2d85b92840ecf) from {username='slave'} at 127.0.0.1:39228
@ 0x7f02d0aac7ea kudu::Thread::SuperviseThread() at ??:0
I20260502 14:01:23.318814 7551 tablet_service.cc:1511] Processing CreateTablet for tablet 546a9fb9f532456d8bc2d85b92840ecf (DEFAULT_TABLE table=default.table_da5e1cd539c94420b562a58316eecee9 [id=d99c8ace41cc4593aadfe92cd5fa1c16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:23.319101 7551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 546a9fb9f532456d8bc2d85b92840ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260502 14:01:23.319062 7273 tablet_service.cc:1511] Processing CreateTablet for tablet 1b64f2f3a9d74673a89ca35f9da8243c (DEFAULT_TABLE table=default.table_d303c0450b934f2bb0f8ab01b92f2e67 [id=360e84ba87bf4b89826c50fe0b181e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260502 14:01:23.319312 7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b64f2f3a9d74673a89ca35f9da8243c. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f02d13f06db start_thread at ??:0
@ 0x7f02ce75e61f clone at ??:0
I20260502 14:01:23.323321 9665 tablet_bootstrap.cc:492] T 5d76651ec6334d63ba3e36f27087958c P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:23.323781 9666 tablet_bootstrap.cc:492] T 546a9fb9f532456d8bc2d85b92840ecf P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:23.324360 9662 tablet_replica.cc:333] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:23.324491 9662 raft_consensus.cc:2243] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:23.324707 9662 raft_consensus.cc:2272] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:23.324872 9666 tablet_bootstrap.cc:654] T 546a9fb9f532456d8bc2d85b92840ecf P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:23.325114 9662 ts_tablet_manager.cc:1916] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:23.326005 9663 tablet_replica.cc:333] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:23.326136 9663 raft_consensus.cc:2243] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:23.326195 9667 tablet_bootstrap.cc:492] T 5d76651ec6334d63ba3e36f27087958c P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:23.326241 9663 raft_consensus.cc:2272] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:23.326519 9663 ts_tablet_manager.cc:1916] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:23.327163 9667 tablet_bootstrap.cc:654] T 5d76651ec6334d63ba3e36f27087958c P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:23.327596 9662 ts_tablet_manager.cc:1929] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:23.327661 9662 log.cc:1199] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/07bd5e1e8b8b4d5a826be923a2198f00
I20260502 14:01:23.327935 9662 ts_tablet_manager.cc:1950] T 07bd5e1e8b8b4d5a826be923a2198f00 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:23.329157 9662 tablet_replica.cc:333] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:23.329248 9665 tablet_bootstrap.cc:654] T 5d76651ec6334d63ba3e36f27087958c P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:23.329277 9662 raft_consensus.cc:2243] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:23.329387 9662 raft_consensus.cc:2272] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:23.329876 9662 ts_tablet_manager.cc:1916] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:23.330336 9666 tablet_bootstrap.cc:492] T 546a9fb9f532456d8bc2d85b92840ecf P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:23.330506 9666 ts_tablet_manager.cc:1403] T 546a9fb9f532456d8bc2d85b92840ecf P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260502 14:01:23.330657 9664 tablet_replica.cc:333] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:23.330802 9664 raft_consensus.cc:2243] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:23.330920 9664 raft_consensus.cc:2272] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:23.331038 9666 raft_consensus.cc:359] T 546a9fb9f532456d8bc2d85b92840ecf P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.331175 9666 raft_consensus.cc:385] T 546a9fb9f532456d8bc2d85b92840ecf P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:23.331209 9666 raft_consensus.cc:740] T 546a9fb9f532456d8bc2d85b92840ecf P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:23.331360 9666 consensus_queue.cc:260] T 546a9fb9f532456d8bc2d85b92840ecf P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.331565 9664 ts_tablet_manager.cc:1916] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:23.332260 9663 ts_tablet_manager.cc:1929] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:23.332305 9662 ts_tablet_manager.cc:1929] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:23.332334 9663 log.cc:1199] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/303cc2525a0d44029b77fbbbf9f12ae1
I20260502 14:01:23.332378 9662 log.cc:1199] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/aee0aa0b9899421e95e37b66b54ee167
I20260502 14:01:23.332600 9663 ts_tablet_manager.cc:1950] T 303cc2525a0d44029b77fbbbf9f12ae1 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:23.333186 9662 ts_tablet_manager.cc:1950] T aee0aa0b9899421e95e37b66b54ee167 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:23.333312 9663 tablet_replica.cc:333] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:23.333535 9666 ts_tablet_manager.cc:1434] T 546a9fb9f532456d8bc2d85b92840ecf P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260502 14:01:23.333902 9662 tablet_replica.cc:333] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84: stopping tablet replica
I20260502 14:01:23.334015 9662 raft_consensus.cc:2243] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:23.334229 9662 raft_consensus.cc:2272] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:23.334610 9662 ts_tablet_manager.cc:1916] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:23.335311 9666 tablet_bootstrap.cc:492] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:23.336381 9666 tablet_bootstrap.cc:654] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:23.337445 9662 ts_tablet_manager.cc:1929] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:23.337527 9662 log.cc:1199] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-1/wal/wals/303cc2525a0d44029b77fbbbf9f12ae1
I20260502 14:01:23.337747 9662 ts_tablet_manager.cc:1950] T 303cc2525a0d44029b77fbbbf9f12ae1 P 1be1472a04ae46e48d852d66903d9c84: Deleting consensus metadata
I20260502 14:01:23.337714 9664 ts_tablet_manager.cc:1929] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:23.337806 9664 log.cc:1199] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/aee0aa0b9899421e95e37b66b54ee167
I20260502 14:01:23.338061 9664 ts_tablet_manager.cc:1950] T aee0aa0b9899421e95e37b66b54ee167 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:23.338158 9665 tablet_bootstrap.cc:492] T 5d76651ec6334d63ba3e36f27087958c P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:23.338724 9663 raft_consensus.cc:2243] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Raft consensus shutting down.
I20260502 14:01:23.338824 9665 ts_tablet_manager.cc:1403] T 5d76651ec6334d63ba3e36f27087958c P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260502 14:01:23.339444 9663 raft_consensus.cc:2272] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:23.339738 9665 raft_consensus.cc:359] T 5d76651ec6334d63ba3e36f27087958c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.339860 9665 raft_consensus.cc:385] T 5d76651ec6334d63ba3e36f27087958c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:23.340440 9665 raft_consensus.cc:740] T 5d76651ec6334d63ba3e36f27087958c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:23.340844 9663 ts_tablet_manager.cc:1916] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:23.341050 9665 consensus_queue.cc:260] T 5d76651ec6334d63ba3e36f27087958c P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.341555 9665 ts_tablet_manager.cc:1434] T 5d76651ec6334d63ba3e36f27087958c P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260502 14:01:23.341681 9664 tablet_replica.cc:333] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:23.341826 9664 raft_consensus.cc:2243] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:23.341933 9664 raft_consensus.cc:2272] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:23.342520 9664 ts_tablet_manager.cc:1916] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:23.342608 9665 tablet_bootstrap.cc:492] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:23.342722 9666 tablet_bootstrap.cc:492] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:23.342825 9666 ts_tablet_manager.cc:1403] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260502 14:01:23.343366 9666 raft_consensus.cc:359] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.343472 9666 raft_consensus.cc:385] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:23.343501 9666 raft_consensus.cc:740] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:23.343684 9666 consensus_queue.cc:260] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.345098 9664 ts_tablet_manager.cc:1929] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:23.345167 9664 log.cc:1199] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/07bd5e1e8b8b4d5a826be923a2198f00
I20260502 14:01:23.345434 9664 ts_tablet_manager.cc:1950] T 07bd5e1e8b8b4d5a826be923a2198f00 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:23.345520 9666 ts_tablet_manager.cc:1434] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260502 14:01:23.347067 9666 tablet_bootstrap.cc:492] T 1b64f2f3a9d74673a89ca35f9da8243c P 4dacd17b49934d2c99a91c60aa672f02: Bootstrap starting.
I20260502 14:01:23.348270 9666 tablet_bootstrap.cc:654] T 1b64f2f3a9d74673a89ca35f9da8243c P 4dacd17b49934d2c99a91c60aa672f02: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:23.348404 9665 tablet_bootstrap.cc:654] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:23.348578 9664 tablet_replica.cc:333] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: stopping tablet replica
I20260502 14:01:23.348711 9664 raft_consensus.cc:2243] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:23.348812 9664 raft_consensus.cc:2272] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:23.349200 9664 ts_tablet_manager.cc:1916] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:23.349748 9667 tablet_bootstrap.cc:492] T 5d76651ec6334d63ba3e36f27087958c P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:23.349849 9667 ts_tablet_manager.cc:1403] T 5d76651ec6334d63ba3e36f27087958c P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20260502 14:01:23.350488 9667 raft_consensus.cc:359] T 5d76651ec6334d63ba3e36f27087958c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.350589 9667 raft_consensus.cc:385] T 5d76651ec6334d63ba3e36f27087958c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:23.350620 9667 raft_consensus.cc:740] T 5d76651ec6334d63ba3e36f27087958c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:23.350719 9663 ts_tablet_manager.cc:1929] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:23.350741 9667 consensus_queue.cc:260] T 5d76651ec6334d63ba3e36f27087958c P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.350797 9663 log.cc:1199] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/aee0aa0b9899421e95e37b66b54ee167
I20260502 14:01:23.350998 9667 ts_tablet_manager.cc:1434] T 5d76651ec6334d63ba3e36f27087958c P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:23.351090 9663 ts_tablet_manager.cc:1950] T aee0aa0b9899421e95e37b66b54ee167 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:23.351207 9667 tablet_bootstrap.cc:492] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:23.351540 9664 ts_tablet_manager.cc:1929] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:23.351598 9664 log.cc:1199] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-2/wal/wals/303cc2525a0d44029b77fbbbf9f12ae1
I20260502 14:01:23.351833 9664 ts_tablet_manager.cc:1950] T 303cc2525a0d44029b77fbbbf9f12ae1 P c2964848cb1648a4bc2c1d671cc54f62: Deleting consensus metadata
I20260502 14:01:23.352130 9663 tablet_replica.cc:333] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02: stopping tablet replica
I20260502 14:01:23.352273 9663 raft_consensus.cc:2243] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260502 14:01:23.352391 9663 raft_consensus.cc:2272] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260502 14:01:23.352810 9663 ts_tablet_manager.cc:1916] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260502 14:01:23.353518 9667 tablet_bootstrap.cc:654] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:23.355041 9666 tablet_bootstrap.cc:492] T 1b64f2f3a9d74673a89ca35f9da8243c P 4dacd17b49934d2c99a91c60aa672f02: No bootstrap required, opened a new log
I20260502 14:01:23.355041 9667 tablet_bootstrap.cc:492] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:23.355129 9666 ts_tablet_manager.cc:1403] T 1b64f2f3a9d74673a89ca35f9da8243c P 4dacd17b49934d2c99a91c60aa672f02: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260502 14:01:23.355129 9667 ts_tablet_manager.cc:1403] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260502 14:01:23.355589 9667 raft_consensus.cc:359] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.355589 9666 raft_consensus.cc:359] T 1b64f2f3a9d74673a89ca35f9da8243c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.355651 9663 ts_tablet_manager.cc:1929] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260502 14:01:23.355690 9667 raft_consensus.cc:385] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:23.355721 9667 raft_consensus.cc:740] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:23.355690 9666 raft_consensus.cc:385] T 1b64f2f3a9d74673a89ca35f9da8243c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:23.355805 9666 raft_consensus.cc:740] T 1b64f2f3a9d74673a89ca35f9da8243c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Initialized, Role: FOLLOWER
I20260502 14:01:23.355835 9663 log.cc:1199] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02: Deleting WAL directory at /tmp/dist-test-taskjX7ZjU/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777730431315494-6645-0/minicluster-data/ts-0/wal/wals/07bd5e1e8b8b4d5a826be923a2198f00
I20260502 14:01:23.355827 9667 consensus_queue.cc:260] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.355943 9666 consensus_queue.cc:260] T 1b64f2f3a9d74673a89ca35f9da8243c P 4dacd17b49934d2c99a91c60aa672f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.356142 9663 ts_tablet_manager.cc:1950] T 07bd5e1e8b8b4d5a826be923a2198f00 P 4dacd17b49934d2c99a91c60aa672f02: Deleting consensus metadata
I20260502 14:01:23.356168 9667 ts_tablet_manager.cc:1434] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260502 14:01:23.356345 9667 tablet_bootstrap.cc:492] T 1b64f2f3a9d74673a89ca35f9da8243c P c2964848cb1648a4bc2c1d671cc54f62: Bootstrap starting.
I20260502 14:01:23.357359 9667 tablet_bootstrap.cc:654] T 1b64f2f3a9d74673a89ca35f9da8243c P c2964848cb1648a4bc2c1d671cc54f62: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:23.357349 9666 ts_tablet_manager.cc:1434] T 1b64f2f3a9d74673a89ca35f9da8243c P 4dacd17b49934d2c99a91c60aa672f02: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260502 14:01:23.359949 8800 raft_consensus.cc:493] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:23.360050 8800 raft_consensus.cc:515] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.360410 8800 leader_election.cc:290] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:23.360860 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546a9fb9f532456d8bc2d85b92840ecf" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:23.360860 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546a9fb9f532456d8bc2d85b92840ecf" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:23.360984 7297 raft_consensus.cc:2468] T 546a9fb9f532456d8bc2d85b92840ecf P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 0.
W20260502 14:01:23.361250 7511 leader_election.cc:343] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Illegal state: must be running to vote when last-logged opid is not known
I20260502 14:01:23.361316 9665 tablet_bootstrap.cc:492] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:23.361321 7511 leader_election.cc:304] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84
I20260502 14:01:23.361428 9665 ts_tablet_manager.cc:1403] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20260502 14:01:23.361495 8800 raft_consensus.cc:2804] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:23.361529 8800 raft_consensus.cc:493] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:23.361553 8800 raft_consensus.cc:3060] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:23.362030 9665 raft_consensus.cc:359] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.362154 9665 raft_consensus.cc:385] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:23.362188 9665 raft_consensus.cc:740] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:23.362334 9665 consensus_queue.cc:260] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.362358 8800 raft_consensus.cc:515] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.362658 9665 ts_tablet_manager.cc:1434] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260502 14:01:23.362705 8800 leader_election.cc:290] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
I20260502 14:01:23.362872 9665 tablet_bootstrap.cc:492] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84: Bootstrap starting.
I20260502 14:01:23.363245 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546a9fb9f532456d8bc2d85b92840ecf" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:23.363539 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546a9fb9f532456d8bc2d85b92840ecf" candidate_uuid: "c2964848cb1648a4bc2c1d671cc54f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:01:23.363660 7297 raft_consensus.cc:3060] T 546a9fb9f532456d8bc2d85b92840ecf P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:23.364104 9665 tablet_bootstrap.cc:654] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84: Neither blocks nor log segments found. Creating new log.
I20260502 14:01:23.364768 7297 raft_consensus.cc:2468] T 546a9fb9f532456d8bc2d85b92840ecf P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2964848cb1648a4bc2c1d671cc54f62 in term 1.
I20260502 14:01:23.364895 9667 tablet_bootstrap.cc:492] T 1b64f2f3a9d74673a89ca35f9da8243c P c2964848cb1648a4bc2c1d671cc54f62: No bootstrap required, opened a new log
I20260502 14:01:23.364984 9667 ts_tablet_manager.cc:1403] T 1b64f2f3a9d74673a89ca35f9da8243c P c2964848cb1648a4bc2c1d671cc54f62: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260502 14:01:23.365108 7508 leader_election.cc:304] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
W20260502 14:01:23.365425 7511 leader_election.cc:343] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Illegal state: must be running to vote when last-logged opid is not known
I20260502 14:01:23.365504 9667 raft_consensus.cc:359] T 1b64f2f3a9d74673a89ca35f9da8243c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.365597 9667 raft_consensus.cc:385] T 1b64f2f3a9d74673a89ca35f9da8243c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:23.365628 8800 raft_consensus.cc:2804] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:23.365626 9667 raft_consensus.cc:740] T 1b64f2f3a9d74673a89ca35f9da8243c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Initialized, Role: FOLLOWER
I20260502 14:01:23.365746 8800 raft_consensus.cc:697] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [term 1 LEADER]: Becoming Leader. State: Replica: c2964848cb1648a4bc2c1d671cc54f62, State: Running, Role: LEADER
I20260502 14:01:23.365886 8800 consensus_queue.cc:237] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.366781 9667 consensus_queue.cc:260] T 1b64f2f3a9d74673a89ca35f9da8243c P c2964848cb1648a4bc2c1d671cc54f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.367095 9667 ts_tablet_manager.cc:1434] T 1b64f2f3a9d74673a89ca35f9da8243c P c2964848cb1648a4bc2c1d671cc54f62: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260502 14:01:23.370473 9665 tablet_bootstrap.cc:492] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84: No bootstrap required, opened a new log
I20260502 14:01:23.370589 9665 ts_tablet_manager.cc:1403] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260502 14:01:23.371104 9665 raft_consensus.cc:359] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.371206 9665 raft_consensus.cc:385] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260502 14:01:23.371232 9665 raft_consensus.cc:740] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Initialized, Role: FOLLOWER
I20260502 14:01:23.371373 9665 consensus_queue.cc:260] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.371678 9665 ts_tablet_manager.cc:1434] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260502 14:01:23.447034 9168 raft_consensus.cc:493] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:23.447207 9168 raft_consensus.cc:515] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.447635 9168 leader_election.cc:290] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:23.448496 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d76651ec6334d63ba3e36f27087958c" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:01:23.448501 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d76651ec6334d63ba3e36f27087958c" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84" is_pre_election: true
I20260502 14:01:23.448649 7572 raft_consensus.cc:2468] T 5d76651ec6334d63ba3e36f27087958c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:23.448649 7434 raft_consensus.cc:2468] T 5d76651ec6334d63ba3e36f27087958c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 0.
I20260502 14:01:23.448983 7233 leader_election.cc:304] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:01:23.449196 9168 raft_consensus.cc:2804] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:23.449261 9168 raft_consensus.cc:493] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:23.449309 9168 raft_consensus.cc:3060] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:23.450265 9168 raft_consensus.cc:515] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.450628 9168 leader_election.cc:290] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Requested vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:23.451125 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d76651ec6334d63ba3e36f27087958c" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:01:23.451260 7572 raft_consensus.cc:3060] T 5d76651ec6334d63ba3e36f27087958c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:23.452323 7572 raft_consensus.cc:2468] T 5d76651ec6334d63ba3e36f27087958c P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
I20260502 14:01:23.452630 7434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d76651ec6334d63ba3e36f27087958c" candidate_uuid: "4dacd17b49934d2c99a91c60aa672f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be1472a04ae46e48d852d66903d9c84"
I20260502 14:01:23.452689 7233 leader_election.cc:304] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:23.452761 7434 raft_consensus.cc:3060] T 5d76651ec6334d63ba3e36f27087958c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:23.452903 9168 raft_consensus.cc:2804] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:23.453117 9168 raft_consensus.cc:697] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [term 1 LEADER]: Becoming Leader. State: Replica: 4dacd17b49934d2c99a91c60aa672f02, State: Running, Role: LEADER
I20260502 14:01:23.453297 9168 consensus_queue.cc:237] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.453668 7434 raft_consensus.cc:2468] T 5d76651ec6334d63ba3e36f27087958c P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dacd17b49934d2c99a91c60aa672f02 in term 1.
W20260502 14:01:23.470618 7484 tablet.cc:2404] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260502 14:01:23.473829 7624 tablet.cc:2404] T 1b64f2f3a9d74673a89ca35f9da8243c P c2964848cb1648a4bc2c1d671cc54f62: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260502 14:01:23.511740 7346 tablet.cc:2404] T 1b64f2f3a9d74673a89ca35f9da8243c P 4dacd17b49934d2c99a91c60aa672f02: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260502 14:01:23.523957 9540 raft_consensus.cc:493] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:23.524170 9540 raft_consensus.cc:515] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.524610 9540 leader_election.cc:290] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:23.525113 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546a9fb9f532456d8bc2d85b92840ecf" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:23.525295 7297 raft_consensus.cc:2393] T 546a9fb9f532456d8bc2d85b92840ecf P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1be1472a04ae46e48d852d66903d9c84 in current term 1: Already voted for candidate c2964848cb1648a4bc2c1d671cc54f62 in this term.
I20260502 14:01:23.525341 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "546a9fb9f532456d8bc2d85b92840ecf" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:01:23.525681 7371 leader_election.cc:304] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84; no voters: 4dacd17b49934d2c99a91c60aa672f02, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:23.526031 9540 raft_consensus.cc:3060] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:23.527787 9540 raft_consensus.cc:2749] T 546a9fb9f532456d8bc2d85b92840ecf P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:01:23.559206 9540 raft_consensus.cc:493] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:23.559412 9540 raft_consensus.cc:515] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.559873 9540 leader_election.cc:290] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:23.560326 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b64f2f3a9d74673a89ca35f9da8243c" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02" is_pre_election: true
I20260502 14:01:23.560468 7297 raft_consensus.cc:2468] T 1b64f2f3a9d74673a89ca35f9da8243c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:01:23.560638 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b64f2f3a9d74673a89ca35f9da8243c" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62" is_pre_election: true
I20260502 14:01:23.560774 7572 raft_consensus.cc:2468] T 1b64f2f3a9d74673a89ca35f9da8243c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 0.
I20260502 14:01:23.560765 7368 leader_election.cc:304] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02; no voters:
I20260502 14:01:23.560928 9540 raft_consensus.cc:2804] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260502 14:01:23.560974 9540 raft_consensus.cc:493] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260502 14:01:23.561004 9540 raft_consensus.cc:3060] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:23.561862 9540 raft_consensus.cc:515] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.562475 9540 leader_election.cc:290] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Requested vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
I20260502 14:01:23.562943 7572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b64f2f3a9d74673a89ca35f9da8243c" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2964848cb1648a4bc2c1d671cc54f62"
I20260502 14:01:23.562846 7297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b64f2f3a9d74673a89ca35f9da8243c" candidate_uuid: "1be1472a04ae46e48d852d66903d9c84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dacd17b49934d2c99a91c60aa672f02"
I20260502 14:01:23.563161 7297 raft_consensus.cc:3060] T 1b64f2f3a9d74673a89ca35f9da8243c P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:23.563215 7572 raft_consensus.cc:3060] T 1b64f2f3a9d74673a89ca35f9da8243c P c2964848cb1648a4bc2c1d671cc54f62 [term 0 FOLLOWER]: Advancing to term 1
I20260502 14:01:23.564227 7297 raft_consensus.cc:2468] T 1b64f2f3a9d74673a89ca35f9da8243c P 4dacd17b49934d2c99a91c60aa672f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:01:23.564564 7572 raft_consensus.cc:2468] T 1b64f2f3a9d74673a89ca35f9da8243c P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be1472a04ae46e48d852d66903d9c84 in term 1.
I20260502 14:01:23.565162 7371 leader_election.cc:304] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62; no voters:
I20260502 14:01:23.565363 9540 raft_consensus.cc:2804] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [term 1 FOLLOWER]: Leader election won for term 1
I20260502 14:01:23.565600 9540 raft_consensus.cc:697] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [term 1 LEADER]: Becoming Leader. State: Replica: 1be1472a04ae46e48d852d66903d9c84, State: Running, Role: LEADER
I20260502 14:01:23.565774 9540 consensus_queue.cc:237] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
W20260502 14:01:23.580370 7510 connection.cc:570] server connection from 127.0.0.1:51706 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:23.580505 7370 connection.cc:570] server connection from 127.0.0.1:37230 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:23.580518 7230 connection.cc:570] server connection from 127.0.0.1:39228 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:23.580703 7233 connection.cc:570] client connection to 127.6.125.125:46147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:23.581072 7371 connection.cc:570] client connection to 127.6.125.125:46147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:23.581792 7631 connection.cc:570] client connection to 127.6.125.125:46147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260502 14:01:23.582546 9615 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:23.581750 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.125:46147 (local address 127.6.125.65:33351)
0502 14:01:23.581986 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:23.582000 (+ 14us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:23.582088 (+ 88us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:23.582423 (+ 335us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":145}
W20260502 14:01:23.582573 9660 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:23.581711 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.125:46147 (local address 127.6.125.67:36867)
0502 14:01:23.581927 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:23.581944 (+ 17us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:23.582052 (+ 108us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:23.582463 (+ 411us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":114}
W20260502 14:01:23.582693 7631 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.6.125.125:46147)
W20260502 14:01:23.583004 7631 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.6.125.125:46147)
W20260502 14:01:23.583038 9637 negotiation.cc:336] Failed RPC negotiation. Trace:
0502 14:01:23.581773 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.6.125.125:46147 (local address 127.6.125.66:58777)
0502 14:01:23.582736 (+ 963us) negotiation.cc:107] Waiting for socket to connect
0502 14:01:23.582752 (+ 16us) client_negotiation.cc:175] Beginning negotiation
0502 14:01:23.582841 (+ 89us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0502 14:01:23.582927 (+ 86us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":520}
W20260502 14:01:23.583130 7631 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.6.125.125:46147)
W20260502 14:01:23.583285 7631 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.6.125.125:46147)
I20260502 14:01:23.749503 9691 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:23.749643 9691 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.750074 9691 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:01:23.750895 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:01:23.751051 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:01:23.751108 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:23.751264 9691 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:01:23.784713 9696 consensus_queue.cc:1048] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:23.789304 9697 consensus_queue.cc:1048] T 546a9fb9f532456d8bc2d85b92840ecf P c2964848cb1648a4bc2c1d671cc54f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:23.804922 9705 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:23.805073 9705 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:23.806748 9705 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:23.807494 9562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:23.809124 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:23.809316 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:23.809427 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:23.809655 9705 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:01:23.841923 9691 consensus_queue.cc:1048] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:23.847064 9711 consensus_queue.cc:1048] T 5d76651ec6334d63ba3e36f27087958c P 4dacd17b49934d2c99a91c60aa672f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:23.960753 9697 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:23.960911 9697 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:23.961459 9697 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:23.962426 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:01:23.962617 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:01:23.962682 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:23.963007 9697 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:24.005625 9540 consensus_queue.cc:1048] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:24.009624 9714 consensus_queue.cc:1048] T 1b64f2f3a9d74673a89ca35f9da8243c P 1be1472a04ae46e48d852d66903d9c84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260502 14:01:24.246228 9696 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:24.246583 9696 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:24.247294 9696 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:24.248397 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:01:24.248592 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:01:24.248651 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:24.249128 9696 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:24.554780 9719 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:24.554939 9719 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:24.555519 9719 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:24.557278 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:24.557410 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:24.557497 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:24.557690 9719 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:01:24.670964 9668 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:24.671121 9668 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:24.671531 9668 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:24.672417 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:01:24.672554 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:01:24.672618 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:24.672755 9668 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:01:24.730907 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 11: this message will repeat every 5th retry.
W20260502 14:01:24.919129 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 11: this message will repeat every 5th retry.
I20260502 14:01:25.099746 6645 master-stress-test.cc:577] Killing test thread 1/25
I20260502 14:01:25.265954 9730 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:25.266139 9730 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:25.266618 9730 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:25.268021 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:25.268265 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:25.268335 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:25.268472 9730 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:01:26.073827 9746 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:26.073980 9746 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:26.074501 9746 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:26.075723 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:26.075834 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:26.075927 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:26.076059 9746 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:01:26.889559 9754 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:26.889688 9754 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:01:26.890156 9754 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:26.890895 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:01:26.891004 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:01:26.891055 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:26.891321 9754 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:26.954509 9754 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:26.954730 9754 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:26.955428 9754 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:26.956247 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:01:26.956583 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:01:26.956686 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:26.957173 9756 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:27.008960 9761 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:27.009177 9761 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:27.009642 9761 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:27.011554 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:27.011689 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:27.011775 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:27.011972 9761 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:01:27.038133 9756 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:27.038292 9756 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:27.038744 9756 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:27.039528 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:01:27.039661 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:01:27.039708 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:27.039853 9756 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:27.636794 9754 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:27.636976 9754 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:27.637436 9754 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:27.638729 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:01:27.639038 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:01:27.639243 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:27.639477 9754 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:27.736588 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:01:27.736721 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:28.419392 9756 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:28.419622 9756 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:28.420173 9756 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:28.421155 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:01:28.421353 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:01:28.421451 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:28.421628 9756 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:28.689845 9711 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:28.690090 9711 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:28.690558 9711 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:01:28.691367 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:01:28.691510 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:01:28.691560 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:28.691756 9711 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260502 14:01:29.831441 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 16: this message will repeat every 5th retry.
W20260502 14:01:30.012668 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 16: this message will repeat every 5th retry.
I20260502 14:01:30.547459 9797 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:30.547605 9797 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:30.548099 9797 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:30.548686 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260502 14:01:30.549448 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:30.549546 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:30.549628 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:30.549762 9797 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:01:31.987596 9696 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:31.987736 9696 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:31.988236 9696 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:31.989017 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:01:31.989200 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:01:31.989289 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:31.989434 9696 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:32.739184 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:01:32.739310 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:32.834714 9754 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:32.834870 9754 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:32.835403 9754 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:32.836153 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:01:32.836326 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:01:32.836404 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:32.836540 9754 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:33.324361 9823 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:33.324514 9823 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:33.325052 9823 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:01:33.325811 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:01:33.325939 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:01:33.325989 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:33.326293 9823 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260502 14:01:34.536814 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 21: this message will repeat every 5th retry.
W20260502 14:01:34.821918 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 21: this message will repeat every 5th retry.
I20260502 14:01:36.184546 9865 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:36.184695 9865 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:36.185303 9865 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:36.185899 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:01:36.186666 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:36.186906 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:36.186977 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:36.187108 9865 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:01:36.934088 9754 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:36.934404 9754 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:36.934892 9754 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:36.935662 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:01:36.935781 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:01:36.936026 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:36.936223 9754 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:37.741545 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:01:37.741657 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:38.095196 9836 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:38.095376 9836 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:38.095813 9836 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:38.096743 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:01:38.096843 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:01:38.096935 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:38.097087 9836 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:01:39.600426 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 26: this message will repeat every 5th retry.
W20260502 14:01:39.822592 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 26: this message will repeat every 5th retry.
I20260502 14:01:40.238487 9877 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:40.238669 9877 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:40.239127 9877 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:01:40.240023 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:01:40.240250 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:01:40.240314 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:40.240512 9877 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:01:42.562247 9754 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:42.562477 9754 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:01:42.563052 9754 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:42.564568 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:01:42.564842 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:01:42.564946 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:42.565131 9754 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:42.745012 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:01:42.745229 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:43.726884 9836 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:43.727041 9836 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:43.727754 9836 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:43.728641 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:01:43.728750 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:01:43.728828 7508 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:43.728983 9836 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:44.675669 9964 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:44.675817 9964 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:44.676291 9964 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:44.676909 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:01:44.678026 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:44.678253 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:44.678333 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:44.678544 9964 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:01:44.710841 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 31: this message will repeat every 5th retry.
W20260502 14:01:45.083510 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 31: this message will repeat every 5th retry.
I20260502 14:01:45.096365 9836 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:45.096539 9836 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:45.097009 9836 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:45.097864 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:01:45.098042 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:01:45.098132 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:45.098289 9836 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:47.747766 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:01:47.747879 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:49.104976 9945 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:49.105132 9945 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:01:49.105664 9945 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:49.106401 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:01:49.106488 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:01:49.106662 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:49.106921 9945 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:01:49.633301 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 36: this message will repeat every 5th retry.
W20260502 14:01:50.515931 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 36: this message will repeat every 5th retry.
I20260502 14:01:51.308122 9756 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:51.308334 9756 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:51.308784 9756 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:51.309612 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:01:51.309708 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:01:51.309810 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:51.310005 9756 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:52.004041 10048 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:52.004175 10048 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:52.004638 10048 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:52.005262 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:01:52.006054 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:52.006320 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:01:52.006415 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:52.006554 10048 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:01:52.391455 7344 heartbeater.cc:646] Failed to heartbeat to 127.6.125.124:43159 (130 consecutive failures): Network error: Failed to ping master at 127.6.125.124:43159: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:52.535823 7623 heartbeater.cc:646] Failed to heartbeat to 127.6.125.125:46147 (124 consecutive failures): Network error: Failed to ping master at 127.6.125.125:46147: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:01:52.623978 7483 heartbeater.cc:646] Failed to heartbeat to 127.6.125.125:46147 (64 consecutive failures): Network error: Failed to ping master at 127.6.125.125:46147: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:52.750655 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:01:52.750788 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:53.842911 9945 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:53.843073 9945 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:53.843501 9945 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:53.844101 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:01:53.844231 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:01:53.844322 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:53.844497 9756 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:54.026559 9982 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:01:54.026690 9982 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:54.027175 9982 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:01:54.028061 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:01:54.028174 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:01:54.028276 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:01:54.028419 9982 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260502 14:01:54.731735 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 41: this message will repeat every 5th retry.
W20260502 14:01:55.024001 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 41: this message will repeat every 5th retry.
I20260502 14:01:55.148644 9836 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:55.148797 9836 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:55.149407 9836 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:55.150141 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:01:55.150259 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:01:55.150334 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:55.150533 9836 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:55.520735 10089 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:01:55.520996 10089 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:01:55.521569 10089 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:01:55.522933 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:01:55.523026 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:01:55.523087 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:01:55.523339 10089 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:01:57.038913 9756 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:01:57.039089 9756 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:01:57.039755 9756 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:01:57.040841 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:01:57.040948 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:01:57.041043 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:57.041370 9756 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:01:57.753480 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:01:57.753607 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:01:58.591610 10127 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:01:58.591876 10127 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:01:58.592698 10127 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:01:58.593781 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:01:58.593953 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:01:58.594048 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:01:58.594275 10127 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:01:59.415697 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 46: this message will repeat every 5th retry.
W20260502 14:01:59.953080 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 46: this message will repeat every 5th retry.
I20260502 14:02:01.884079 10154 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:01.884249 10154 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:01.884773 10154 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:01.885866 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:02:01.885982 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:02:01.886039 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:01.886199 10154 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:02:02.755599 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:02:02.755719 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:02:03.061148 9982 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:02:03.061308 9982 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:03.061820 9982 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:02:03.062820 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:02:03.062942 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:02:03.063002 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:02:03.063258 9982 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260502 14:02:04.235543 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 51: this message will repeat every 5th retry.
I20260502 14:02:04.638697 10143 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:04.638850 10143 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:04.639281 10143 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:02:04.640025 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:02:04.640183 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:02:04.640280 7511 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:04.640482 10143 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:02:04.796499 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 51: this message will repeat every 5th retry.
I20260502 14:02:06.222994 10221 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:02:06.223160 10221 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:02:06.223755 10221 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:02:06.224578 9562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 14:02:06.225495 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:02:06.225625 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:02:06.225706 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:02:06.225886 10221 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:02:06.288769 10201 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:02:06.288923 10201 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:06.289402 10201 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:02:06.290266 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:02:06.290398 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:02:06.290473 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:02:06.290601 10201 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:02:07.758111 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:02:07.758253 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:02:09.022459 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 56: this message will repeat every 5th retry.
W20260502 14:02:09.455849 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 56: this message will repeat every 5th retry.
I20260502 14:02:09.825248 10246 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:02:09.825400 10246 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:09.825889 10246 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:09.826759 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:02:09.826889 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:02:09.827068 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:09.827365 10246 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:02:11.603734 10246 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:11.603938 10246 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:11.604413 10246 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:11.605386 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:02:11.605525 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:02:11.605592 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:11.605790 10246 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:02:12.760988 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:02:12.761286 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:02:14.165565 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 61: this message will repeat every 5th retry.
I20260502 14:02:14.291642 10321 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:02:14.291810 10321 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:14.292371 10321 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:14.293360 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:02:14.293493 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:02:14.293586 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:14.293766 10321 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:02:14.839975 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 61: this message will repeat every 5th retry.
I20260502 14:02:15.727808 10144 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:15.728058 10144 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:02:15.728639 10144 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:02:15.729452 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:02:15.729990 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:02:15.730151 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:15.730819 10144 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:02:17.763952 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:02:17.764094 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:02:17.770071 10334 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:17.770236 10334 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:17.770677 10334 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:17.771816 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:02:17.772311 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:02:17.772380 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:17.772516 10321 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:02:19.412671 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 66: this message will repeat every 5th retry.
I20260502 14:02:19.574849 10144 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:02:19.575011 10144 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:19.575444 10144 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:19.576350 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:02:19.576478 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:02:19.576555 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:19.576735 10144 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:02:19.698767 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 66: this message will repeat every 5th retry.
I20260502 14:02:19.840917 10334 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:19.841086 10334 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:19.841639 10334 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:02:19.842393 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:02:19.842489 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:02:19.842562 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:19.842705 10334 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:02:22.069126 10255 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:02:22.069283 10255 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:22.069803 10255 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:02:22.070600 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:02:22.070713 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:02:22.070749 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:02:22.070886 10255 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:02:22.766546 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:02:22.766683 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:02:24.083420 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 71: this message will repeat every 5th retry.
W20260502 14:02:24.676479 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 71: this message will repeat every 5th retry.
I20260502 14:02:25.238199 10445 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:02:25.238368 10445 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:02:25.238884 10445 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:02:25.239478 9562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:02:25.240163 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:02:25.240250 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:02:25.240320 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:02:25.240455 10445 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:02:27.769011 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:02:27.769158 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:02:28.311661 10463 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:28.311810 10463 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:28.312314 10463 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:28.313091 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:02:28.313174 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:02:28.313252 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:28.313383 10463 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:02:29.404718 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 76: this message will repeat every 5th retry.
W20260502 14:02:29.408509 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 76: this message will repeat every 5th retry.
I20260502 14:02:29.886776 10483 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:29.886940 10483 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:02:29.887552 10483 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:02:29.888270 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:02:29.888361 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:02:29.888461 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:29.888602 10483 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:02:31.586020 10483 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:02:31.586179 10483 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:31.586761 10483 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:31.587587 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:02:31.587803 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:02:31.587911 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:31.588070 10483 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:02:32.771848 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:02:32.772046 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:02:34.420804 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 81: this message will repeat every 5th retry.
W20260502 14:02:34.748859 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 81: this message will repeat every 5th retry.
I20260502 14:02:35.304159 10483 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:35.304312 10483 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:02:35.305001 10483 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:02:35.305775 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:02:35.305888 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:02:35.305989 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:35.306134 10483 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:02:36.762670 10504 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:02:36.762835 10504 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:36.763271 10504 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:36.764158 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:02:36.764283 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:02:36.764343 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:36.764642 10504 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:02:36.766800 10504 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:36.766928 10504 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:36.767376 10504 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:02:36.768397 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:02:36.768528 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:02:36.768611 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:36.768800 10504 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:02:37.774616 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:02:37.774745 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:02:38.599257 10483 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:38.599393 10483 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:38.600101 10483 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:38.600868 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:02:38.601096 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:02:38.601189 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:38.601329 10483 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:02:39.115370 10608 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:02:39.115617 10608 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:02:39.116118 10608 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:02:39.116714 9562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:02:39.117479 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:02:39.117643 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:02:39.117733 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:02:39.117892 10608 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:02:39.323835 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 86: this message will repeat every 5th retry.
W20260502 14:02:39.949862 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 86: this message will repeat every 5th retry.
I20260502 14:02:40.806648 10615 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:02:40.806819 10615 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:40.807598 10615 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:02:40.808439 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:02:40.808562 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:02:40.808615 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:02:40.808790 10615 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:02:42.080134 10648 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:02:42.080274 10648 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:02:42.080703 10648 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:02:42.082033 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:02:42.082408 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:02:42.082492 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:02:42.082676 10648 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:02:42.777572 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:02:42.777709 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:02:44.288556 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 91: this message will repeat every 5th retry.
I20260502 14:02:44.786583 10686 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:02:44.786722 10686 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:02:44.787153 10686 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:02:44.787827 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 14:02:44.788686 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:02:44.788789 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:02:44.788869 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:02:44.789007 10686 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:02:45.387935 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 91: this message will repeat every 5th retry.
I20260502 14:02:45.894703 10615 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:02:45.894846 10615 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:45.895269 10615 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:02:45.896158 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:02:45.896337 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:02:45.896397 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:02:45.896581 10615 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:02:47.780262 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:02:47.780413 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:02:47.989238 10707 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:02:47.989511 10707 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:47.990049 10707 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:47.990831 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:02:47.990931 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:02:47.991004 7508 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:47.991134 10707 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:02:48.833871 10738 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:02:48.834029 10738 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:02:48.834503 10738 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:02:48.836213 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:02:48.836974 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:02:48.837126 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:02:48.837365 10738 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:02:49.073392 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 96: this message will repeat every 5th retry.
I20260502 14:02:49.380668 10734 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:49.380823 10734 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:02:49.381256 10734 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:02:49.382064 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:02:49.382176 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:02:49.382246 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:49.382504 10734 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:02:50.685314 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 96: this message will repeat every 5th retry.
I20260502 14:02:50.967823 10615 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:02:50.968086 10615 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:50.968628 10615 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:02:50.969790 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:02:50.969928 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:02:50.969978 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:02:50.970172 10615 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:02:51.351830 10707 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:02:51.352021 10707 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:51.352468 10707 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:51.353205 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:02:51.353324 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:02:51.353395 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:51.353536 10707 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:02:52.533188 7344 heartbeater.cc:646] Failed to heartbeat to 127.6.125.124:43159 (250 consecutive failures): Network error: Failed to ping master at 127.6.125.124:43159: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:02:52.600767 7622 heartbeater.cc:646] Failed to heartbeat to 127.6.125.124:43159 (469 consecutive failures): Network error: Failed to ping master at 127.6.125.124:43159: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:02:52.760116 7483 heartbeater.cc:646] Failed to heartbeat to 127.6.125.125:46147 (184 consecutive failures): Network error: Failed to ping master at 127.6.125.125:46147: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:02:52.782327 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:02:52.782454 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:02:53.425840 10734 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:53.426005 10734 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:53.426689 10734 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:53.427385 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:02:53.427485 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:02:53.427570 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:53.427790 10734 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:02:53.763671 10615 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:02:53.763813 10615 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:53.764256 10615 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:02:53.764837 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:02:53.764972 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:02:53.765024 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:02:53.765168 10615 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260502 14:02:53.867317 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 101: this message will repeat every 5th retry.
I20260502 14:02:55.441862 10809 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:02:55.442016 10809 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:55.442515 10809 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:02:55.443312 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:02:55.443408 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:02:55.443512 7511 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:55.443697 10809 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:02:55.513664 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 101: this message will repeat every 5th retry.
I20260502 14:02:57.784677 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:02:57.784811 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:02:58.905790 10846 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:02:58.905954 10846 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:02:58.907210 10846 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:02:58.908357 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:02:58.908581 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:02:58.908660 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:02:58.909039 10846 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:02:58.910339 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 106: this message will repeat every 5th retry.
W20260502 14:03:00.517952 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 106: this message will repeat every 5th retry.
I20260502 14:03:01.915180 10808 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:01.915337 10808 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:03:01.916064 10808 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:03:01.916826 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:03:01.916944 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:03:01.917004 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:01.917143 10808 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:02.542500 10846 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:02.542665 10846 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:02.543078 10846 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:03:02.544047 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:03:02.544174 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:03:02.544240 7511 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:02.544380 10846 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:02.790500 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:03:02.790604 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:03:03.756978 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 111: this message will repeat every 5th retry.
W20260502 14:03:05.601243 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 111: this message will repeat every 5th retry.
I20260502 14:03:05.623332 10615 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:03:05.623589 10615 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:05.624166 10615 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:03:05.624917 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:03:05.625097 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:03:05.625149 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:03:05.625537 10615 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:03:07.693976 10846 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:07.694140 10846 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:07.694713 10846 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:07.695643 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:03:07.695817 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:03:07.695940 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:07.696102 10846 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:07.793457 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:03:07.793599 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:03:07.822360 10953 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:03:07.822513 10953 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:03:07.823087 10953 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:03:07.823748 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 14:03:07.824465 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:03:07.824579 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:03:07.824663 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:03:07.824800 10953 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:03:08.871522 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 116: this message will repeat every 5th retry.
I20260502 14:03:09.242753 10809 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:09.242921 10809 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:09.243429 10809 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:09.244580 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:03:09.244912 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:03:09.245215 7508 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:09.245472 10809 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:09.644251 10976 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:03:09.644387 10976 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:03:09.644812 10976 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:03:09.646304 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:03:09.646575 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:03:09.646646 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:03:09.646824 10976 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:03:09.905083 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 116: this message will repeat every 5th retry.
I20260502 14:03:11.104756 10808 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:11.104987 10808 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:11.105614 10808 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:11.106472 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:03:11.106582 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:03:11.106662 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:11.107070 10808 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:11.372246 10808 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:11.372377 10808 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:11.372782 10808 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:11.373481 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:03:11.373726 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:03:11.373790 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:11.373927 10808 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:11.473065 10964 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:03:11.473224 10964 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:11.473804 10964 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:03:11.475011 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:03:11.475131 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:03:11.475160 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:03:11.475368 10964 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:03:12.427806 10990 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:12.427980 10990 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:12.428454 10990 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:03:12.429335 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:03:12.429471 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:03:12.429522 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:12.429670 10990 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:12.796388 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:03:12.796577 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:03:12.809755 10982 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:12.809918 10982 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:12.810696 10982 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:12.811805 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:03:12.812279 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:03:12.812634 7508 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:12.812872 10982 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:03:14.091539 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 121: this message will repeat every 5th retry.
W20260502 14:03:14.992043 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 121: this message will repeat every 5th retry.
I20260502 14:03:17.798870 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:03:17.799012 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:03:18.501142 11061 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:18.501461 11061 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:03:18.502501 11061 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:03:18.503651 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:03:18.503787 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:03:18.503839 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:18.503991 11061 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:03:18.914273 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 126: this message will repeat every 5th retry.
W20260502 14:03:20.284157 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 126: this message will repeat every 5th retry.
I20260502 14:03:20.846829 11061 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:20.846992 11061 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:20.847849 11061 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:20.849076 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:03:20.850577 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:03:20.850697 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:20.850948 11061 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:22.698040 11131 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:03:22.698190 11131 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:03:22.698741 11131 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:03:22.699368 9562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 14:03:22.700263 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:03:22.700395 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:03:22.700537 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:03:22.700750 11131 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:03:22.792119 9564 maintenance_manager.cc:419] P 9d590d630acd4892b59504b1c66c4f2d: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033356
I20260502 14:03:22.824616 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:03:22.824751 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:03:22.830720 11125 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:22.830869 11125 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:22.831578 11125 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:22.832459 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:03:22.832635 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:03:22.832726 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:22.832935 11125 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:22.846856 9563 maintenance_manager.cc:643] P 9d590d630acd4892b59504b1c66c4f2d: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.054s user 0.028s sys 0.000s Metrics: {"bytes_written":27591,"cfile_init":1,"dirs.queue_time_us":580,"dirs.run_cpu_time_us":266,"dirs.run_wall_time_us":1156,"drs_written":1,"lbm_read_time_us":74,"lbm_reads_lt_1ms":4,"lbm_write_time_us":905,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":67,"thread_start_us":471,"threads_started":2,"wal-append.queue_time_us":244}
I20260502 14:03:22.847831 9564 maintenance_manager.cc:419] P 9d590d630acd4892b59504b1c66c4f2d: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4042 bytes on disk
I20260502 14:03:22.848460 9563 maintenance_manager.cc:643] P 9d590d630acd4892b59504b1c66c4f2d: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20260502 14:03:23.452323 11143 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:23.452647 11143 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:23.453293 11143 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:23.454232 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:03:23.454334 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:03:23.454459 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:23.454766 11143 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:23.680034 11015 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:03:23.680189 11015 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:23.680768 11015 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:03:23.681455 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:03:23.681671 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:03:23.681732 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:03:23.681859 11015 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260502 14:03:23.850556 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 131: this message will repeat every 5th retry.
W20260502 14:03:25.521695 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 131: this message will repeat every 5th retry.
I20260502 14:03:27.827486 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:03:27.827634 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:03:28.515534 11169 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:28.515702 11169 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:28.516446 11169 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:28.517267 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:03:28.517575 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:03:28.517654 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:28.517805 11169 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:03:28.973989 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 136: this message will repeat every 5th retry.
I20260502 14:03:29.009727 11169 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:29.009910 11169 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:03:29.010367 11169 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:03:29.011171 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:03:29.011278 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:03:29.011379 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:29.011615 11169 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:30.406252 11225 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:03:30.406395 11225 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:03:30.406953 11225 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:03:30.407521 9562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:03:30.408356 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:03:30.408443 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:03:30.408522 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:03:30.408676 11225 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:03:30.935235 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 136: this message will repeat every 5th retry.
I20260502 14:03:32.183454 11169 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:32.183620 11169 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:32.184103 11169 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:03:32.184906 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:03:32.185000 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:03:32.185086 7511 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:32.185248 11169 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:32.829909 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:03:32.830024 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:03:34.048111 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 141: this message will repeat every 5th retry.
I20260502 14:03:35.185302 11269 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:35.185611 11269 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:35.186167 11269 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:35.186918 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:03:35.187101 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:03:35.187192 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:35.187498 11269 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:03:36.047081 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 141: this message will repeat every 5th retry.
I20260502 14:03:37.343950 11321 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:03:37.344105 11321 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:03:37.344547 11321 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:03:37.345152 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:03:37.345820 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:03:37.345988 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:03:37.346057 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:03:37.346359 11321 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:03:37.674685 11169 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:37.674850 11169 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:37.675283 11169 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:37.676280 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:03:37.676416 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:03:37.676472 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:37.676838 11169 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:37.832209 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:03:37.832329 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:03:38.377523 11276 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:38.377699 11276 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:38.378294 11276 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:38.379132 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:03:38.379295 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:03:38.379380 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:38.379525 11276 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:03:38.664163 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 146: this message will repeat every 5th retry.
W20260502 14:03:41.014345 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 146: this message will repeat every 5th retry.
I20260502 14:03:41.110040 11169 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:41.110216 11169 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:41.110782 11169 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:41.111640 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:03:41.111750 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:03:41.111862 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:41.112317 11169 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:42.669639 11391 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:42.669803 11391 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:42.670302 11391 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:42.671077 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:03:42.671176 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:03:42.671231 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:42.671360 11391 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:42.834645 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:03:42.834789 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:03:43.499619 11358 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:03:43.499794 11358 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:43.500443 11358 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:03:43.501228 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:03:43.501338 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:03:43.501394 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:03:43.501583 11358 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260502 14:03:43.868664 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 151: this message will repeat every 5th retry.
I20260502 14:03:43.961664 11169 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:43.961826 11169 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:43.962311 11169 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:03:43.963122 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:03:43.963311 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:03:43.963457 7511 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:43.963690 11169 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:45.255865 11446 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:45.256084 11446 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:45.256541 11446 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:45.257292 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:03:45.257457 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:03:45.257555 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:45.257704 11446 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:03:46.035776 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 151: this message will repeat every 5th retry.
I20260502 14:03:46.920926 11446 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:46.921073 11446 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:03:46.921494 11446 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:03:46.922199 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:03:46.922282 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:03:46.922380 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:46.922523 11446 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:47.837179 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:03:47.837301 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:03:48.102134 11358 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:03:48.102300 11358 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:48.102743 11358 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:03:48.103578 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:03:48.103760 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:03:48.103808 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:03:48.104007 11358 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:03:48.451604 11496 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:03:48.451772 11496 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:03:48.452569 11496 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:03:48.453249 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:03:48.454123 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:03:48.454320 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:03:48.454409 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:03:48.454566 11496 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:03:48.798790 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 156: this message will repeat every 5th retry.
I20260502 14:03:51.214334 11446 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:51.214498 11446 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:51.214944 11446 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:51.215749 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:03:51.215924 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:03:51.216018 7508 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:51.216250 11446 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:03:51.319036 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 156: this message will repeat every 5th retry.
W20260502 14:03:52.668471 7344 heartbeater.cc:646] Failed to heartbeat to 127.6.125.124:43159 (370 consecutive failures): Network error: Failed to ping master at 127.6.125.124:43159: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:03:52.779328 7622 heartbeater.cc:646] Failed to heartbeat to 127.6.125.124:43159 (713 consecutive failures): Network error: Failed to ping master at 127.6.125.124:43159: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:03:52.847195 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:03:52.847397 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:03:52.900478 7482 heartbeater.cc:646] Failed to heartbeat to 127.6.125.124:43159 (365 consecutive failures): Network error: Failed to ping master at 127.6.125.124:43159: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:03:53.808847 11541 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:53.808991 11541 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:53.809569 11541 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:53.810351 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:03:53.810457 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:03:53.810634 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:53.810927 11541 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:03:53.886667 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 161: this message will repeat every 5th retry.
I20260502 14:03:54.543807 11594 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:03:54.544014 11594 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:03:54.544502 11594 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:03:54.545142 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:03:54.546051 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:03:54.546133 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:03:54.546193 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:03:54.546347 11594 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:03:54.673198 11540 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:54.673352 11540 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:54.673943 11540 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:54.674646 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:03:54.674824 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:03:54.674908 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:54.675038 11540 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:03:54.781962 11540 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:03:54.782126 11540 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:03:54.782593 11540 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:03:54.783340 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:03:54.783463 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:03:54.783595 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:54.783887 11540 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:03:56.389345 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 161: this message will repeat every 5th retry.
I20260502 14:03:57.798666 11565 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:03:57.798813 11565 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:57.799206 11565 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:03:57.800170 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:03:57.800328 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:03:57.800383 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:03:57.800623 11565 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:03:57.851188 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:03:57.851369 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:03:59.135774 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 166: this message will repeat every 5th retry.
I20260502 14:03:59.476541 11618 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:03:59.476712 11618 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:03:59.477626 11618 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:03:59.478477 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:03:59.478593 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:03:59.478675 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:03:59.478817 11618 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:01.443035 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 166: this message will repeat every 5th retry.
I20260502 14:04:02.303308 11717 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:04:02.303447 11717 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:02.303865 11717 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:02.304559 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:04:02.304697 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:04:02.304757 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:02.304894 11717 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:02.853967 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:04:02.854104 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:04:03.135126 11618 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:03.135377 11618 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:03.135947 11618 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:04:03.136739 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:04:03.137050 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:04:03.137210 7511 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:03.137387 11717 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:03.914137 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 171: this message will repeat every 5th retry.
I20260502 14:04:04.322916 11618 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:04.323067 11618 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:04:04.323480 11618 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:04:04.324347 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:04:04.324440 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:04:04.324616 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:04.324896 11618 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:06.397775 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 171: this message will repeat every 5th retry.
I20260502 14:04:07.856274 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:04:07.856411 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:04:08.599063 11802 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:08.599223 11802 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:08.599653 11802 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:08.600493 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:04:08.600613 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:04:08.600679 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:08.600828 11802 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:09.056030 11812 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:04:09.056185 11812 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:09.056917 11812 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:09.057668 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:04:09.057776 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:04:09.057838 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:09.057971 11812 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:09.126390 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 176: this message will repeat every 5th retry.
I20260502 14:04:10.071412 11850 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:04:10.071588 11850 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:04:10.072261 11850 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:04:10.073273 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:04:10.073273 9562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:04:10.074616 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:04:10.074800 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:04:10.074854 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:04:10.075062 11850 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:04:10.355751 11813 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:04:10.355978 11813 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:10.356407 11813 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:10.357080 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:04:10.357169 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:04:10.357261 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:10.357405 11813 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:11.230456 11813 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:11.230705 11813 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:04:11.231192 11813 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:04:11.232213 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:04:11.232326 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:04:11.232417 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:11.232570 11813 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:11.591331 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 176: this message will repeat every 5th retry.
I20260502 14:04:12.859879 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:04:12.860064 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:04:13.662273 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 181: this message will repeat every 5th retry.
I20260502 14:04:13.887940 11910 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:04:13.888089 11910 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:04:13.888624 11910 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:04:13.890736 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:04:13.890864 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:04:13.890918 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:04:13.891129 11910 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:04:14.392845 11905 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:14.393005 11905 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:04:14.393440 11905 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:04:14.394218 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:04:14.394340 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:04:14.394398 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:14.394531 11905 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:16.876200 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 181: this message will repeat every 5th retry.
I20260502 14:04:17.498858 11934 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:04:17.499034 11934 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:17.499758 11934 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:04:17.500598 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:04:17.500756 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:04:17.500804 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:04:17.501001 11934 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:04:17.862334 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:04:17.862462 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:04:17.864007 11812 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:17.864130 11812 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:04:17.864547 11812 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:04:17.865420 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:04:17.865557 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:04:17.865628 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:17.865833 11812 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:18.280145 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 186: this message will repeat every 5th retry.
I20260502 14:04:19.667589 11905 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:19.667716 11905 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:19.668134 11905 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:04:19.668741 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:04:19.668820 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:04:19.668882 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:19.669030 11905 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:20.726334 12011 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:04:20.726473 12011 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:04:20.726986 12011 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:04:20.727504 9562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260502 14:04:20.728379 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:04:20.728802 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:04:20.728897 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:04:20.729070 12011 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:04:20.972584 11905 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:20.972740 11905 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:20.973444 11905 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:20.974699 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:04:20.974814 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:04:20.974905 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:20.975148 11905 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:21.548133 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 186: this message will repeat every 5th retry.
W20260502 14:04:22.844347 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 191: this message will repeat every 5th retry.
I20260502 14:04:22.864912 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:04:22.865023 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:04:23.758486 11812 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:04:23.758626 11812 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:23.759037 11812 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:23.759711 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:04:23.759792 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:04:23.759856 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:23.760040 11812 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:25.473064 12085 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:04:25.473204 12085 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:04:25.473639 12085 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:04:25.475036 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:04:25.475129 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:04:25.475196 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:04:25.475337 12085 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:04:26.482460 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 191: this message will repeat every 5th retry.
I20260502 14:04:27.828358 12116 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:04:27.828513 12116 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:27.829102 12116 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:27.829916 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:04:27.830070 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:04:27.830149 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:27.830305 12116 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:27.867312 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:04:27.867422 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:04:27.912498 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 196: this message will repeat every 5th retry.
I20260502 14:04:28.043138 12108 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:28.043292 12108 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:04:28.043730 12108 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:04:28.044538 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:04:28.044626 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:04:28.044798 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:28.044924 12108 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:28.217363 11934 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:04:28.217631 11934 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:28.218343 11934 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:04:28.219199 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:04:28.219343 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:04:28.219400 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:04:28.219619 11934 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:04:28.903146 12139 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:04:28.903275 12139 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:28.903645 12139 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:28.904374 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:04:28.904469 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:04:28.904546 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:28.904698 12139 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:30.151736 12159 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:30.151886 12159 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:30.152392 12159 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:04:30.153122 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:04:30.153265 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:04:30.153342 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:30.153491 12159 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:31.416153 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 196: this message will repeat every 5th retry.
I20260502 14:04:32.869580 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:04:32.869690 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:04:33.201251 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 201: this message will repeat every 5th retry.
I20260502 14:04:35.273252 12139 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:35.273406 12139 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:04:35.274029 12139 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:04:35.274797 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:04:35.274883 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:04:35.274966 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:35.275099 12139 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:35.931911 12192 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:35.932065 12192 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:35.932514 12192 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:35.933349 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:04:35.933439 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:04:35.933524 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:35.933719 12192 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:36.694128 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 201: this message will repeat every 5th retry.
I20260502 14:04:37.216153 12267 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:04:37.216295 12267 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:04:37.216697 12267 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:04:37.217339 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 14:04:37.218091 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:04:37.218190 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:04:37.218272 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:04:37.218427 12267 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:04:37.872292 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:04:37.872430 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:04:38.095794 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 206: this message will repeat every 5th retry.
I20260502 14:04:38.215379 12280 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:04:38.215531 12280 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:38.215978 12280 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:38.216647 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:04:38.216840 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:04:38.216902 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:38.217038 12280 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:40.283342 12280 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:40.283504 12280 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:40.283972 12280 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:40.284648 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:04:40.284744 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:04:40.284816 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:40.284970 12280 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:40.512858 12280 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:40.513023 12280 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:40.513438 12280 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:04:40.514170 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:04:40.514267 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:04:40.514325 7511 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:40.514446 12280 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:41.780253 12341 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:04:41.780395 12341 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:04:41.780831 12341 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:04:41.782058 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:04:41.782195 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:04:41.782262 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:04:41.782383 12341 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:04:41.798588 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 206: this message will repeat every 5th retry.
I20260502 14:04:42.874934 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:04:42.875077 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:04:43.154579 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 211: this message will repeat every 5th retry.
I20260502 14:04:43.839365 12371 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:04:43.839586 12371 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:43.840368 12371 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:43.841229 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:04:43.841454 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:04:43.841589 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:43.841806 12371 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:47.120661 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 211: this message will repeat every 5th retry.
I20260502 14:04:47.553282 11934 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:04:47.553432 11934 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:47.554200 11934 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:04:47.555163 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:04:47.555303 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:04:47.555342 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:04:47.555493 11934 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:04:47.878333 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:04:47.878556 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:04:48.147571 12437 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:04:48.147711 12279 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:48.147727 12437 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:04:48.147907 12279 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:48.148229 12437 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
I20260502 14:04:48.148319 12279 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:04:48.148854 9562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260502 14:04:48.149334 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:04:48.149457 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:04:48.149528 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
W20260502 14:04:48.149760 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:04:48.149741 12279 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:48.150018 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:04:48.150094 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:04:48.150369 12437 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:04:48.335125 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 216: this message will repeat every 5th retry.
I20260502 14:04:50.520242 12279 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:50.520402 12279 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:50.520932 12279 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:04:50.521665 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:04:50.521787 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:04:50.521889 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:50.522015 12279 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:51.824529 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 216: this message will repeat every 5th retry.
I20260502 14:04:52.111768 12280 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:52.111965 12280 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:04:52.112339 12280 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:04:52.113111 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:04:52.113247 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:04:52.113339 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:52.113549 12280 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:52.806365 7344 heartbeater.cc:646] Failed to heartbeat to 127.6.125.124:43159 (490 consecutive failures): Network error: Failed to ping master at 127.6.125.124:43159: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:04:52.881372 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:04:52.881501 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:04:53.039844 7483 heartbeater.cc:646] Failed to heartbeat to 127.6.125.125:46147 (424 consecutive failures): Network error: Failed to ping master at 127.6.125.125:46147: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:04:53.150478 7623 heartbeater.cc:646] Failed to heartbeat to 127.6.125.125:46147 (864 consecutive failures): Network error: Failed to ping master at 127.6.125.125:46147: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:04:53.730087 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 221: this message will repeat every 5th retry.
I20260502 14:04:53.894769 12494 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:04:53.895028 12494 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:53.896389 12494 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:53.897616 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:04:53.897924 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:04:53.898027 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:53.898205 12494 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:54.182622 12280 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:04:54.182794 12280 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:54.183353 12280 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:54.184104 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:04:54.184218 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:04:54.184303 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:54.184450 12280 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:04:55.193702 11934 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:04:55.193931 11934 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:55.194370 11934 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:04:55.195170 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:04:55.195297 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:04:55.195396 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:04:55.195662 11934 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:04:56.883937 12279 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:04:56.884119 12279 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:56.884524 12279 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:04:56.885332 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:04:56.885458 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:04:56.885517 7508 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:04:56.885659 12279 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:04:57.190658 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 221: this message will repeat every 5th retry.
I20260502 14:04:57.884210 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:04:57.884359 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:04:58.790890 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 226: this message will repeat every 5th retry.
I20260502 14:04:59.837952 12551 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:04:59.838160 12551 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:04:59.838563 12551 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:04:59.839118 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:04:59.839237 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:04:59.839285 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:04:59.839470 12551 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:05:00.194167 12617 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:05:00.194443 12617 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:05:00.195247 12617 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:05:00.195780 9562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:05:00.197001 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:05:00.197146 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:05:00.197202 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:05:00.197419 12617 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:05:01.907990 12575 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:01.908126 12575 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:01.908607 12575 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:01.909283 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:05:01.909372 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:05:01.909457 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:01.909607 12575 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:05:02.420812 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 226: this message will repeat every 5th retry.
I20260502 14:05:02.887076 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:05:02.887280 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:05:03.767215 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 231: this message will repeat every 5th retry.
I20260502 14:05:06.290108 12614 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:05:06.290292 12614 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:06.290741 12614 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:06.291538 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:05:06.291646 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:05:06.291726 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:06.291872 12614 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:06.752348 12646 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:06.752552 12646 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:06.753224 12646 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:05:06.754041 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:05:06.754132 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:05:06.754212 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:06.754383 12646 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:07.031059 12575 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:05:07.031205 12575 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:07.031678 12575 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:07.032130 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:05:07.032289 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:05:07.032351 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:07.032478 12575 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:05:07.279815 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 231: this message will repeat every 5th retry.
I20260502 14:05:07.889892 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:05:07.890025 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:05:08.693322 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 236: this message will repeat every 5th retry.
I20260502 14:05:11.199002 12614 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:11.199157 12614 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:05:11.199568 12614 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:05:11.200387 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:05:11.200495 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:05:11.200577 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:11.200713 12614 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:12.358758 12792 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:05:12.358963 12792 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:05:12.359519 12792 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:05:12.360134 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:05:12.360802 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:05:12.360970 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:05:12.361099 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:05:12.361246 12792 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:05:12.493467 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 236: this message will repeat every 5th retry.
I20260502 14:05:12.893162 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:05:12.893288 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:05:13.848136 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 241: this message will repeat every 5th retry.
I20260502 14:05:16.268785 12661 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:05:16.268939 12661 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:16.269470 12661 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:05:16.270327 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:05:16.270457 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:05:16.270495 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:05:16.270646 12661 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:05:17.688169 12863 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:17.688333 12863 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:17.688861 12863 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:17.689617 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:05:17.689764 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:05:17.689852 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:17.689982 12863 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:17.895467 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:05:17.895579 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:05:17.913146 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 241: this message will repeat every 5th retry.
W20260502 14:05:18.312752 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 246: this message will repeat every 5th retry.
I20260502 14:05:21.111954 12881 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:21.112165 12881 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:21.112627 12881 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:05:21.113340 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:05:21.113453 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:05:21.113529 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:21.113662 12881 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:22.738920 12944 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:05:22.739069 12944 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:05:22.739799 12944 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:05:22.740617 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:05:22.741782 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:05:22.741909 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:05:22.741984 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:05:22.742184 12944 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:05:22.898109 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:05:22.898306 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:05:22.926532 12882 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:05:22.926687 12882 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:22.927079 12882 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:22.927929 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:05:22.928047 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:05:22.928200 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:22.928376 12882 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:05:22.930899 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 251: this message will repeat every 5th retry.
W20260502 14:05:22.966506 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 246: this message will repeat every 5th retry.
I20260502 14:05:24.303470 12661 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:05:24.303627 12661 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:24.304208 12661 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:05:24.304975 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:05:24.305265 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:05:24.305351 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:05:24.305557 12661 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:05:25.305570 12882 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:05:25.305713 12882 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:25.306152 12882 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:25.306839 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:05:25.306989 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:05:25.307080 7508 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:25.307255 12882 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:27.198071 12881 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:27.198210 12881 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:05:27.198716 12881 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:05:27.199632 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:05:27.199743 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:05:27.199810 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:27.200006 12881 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:27.900799 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:05:27.900939 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:05:27.930749 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 256: this message will repeat every 5th retry.
W20260502 14:05:28.478060 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 251: this message will repeat every 5th retry.
I20260502 14:05:30.887560 13030 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:05:30.887717 13030 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:30.888198 13030 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:05:30.889231 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:05:30.889365 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:05:30.889398 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:05:30.889645 13030 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:05:32.529439 13039 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:32.529608 13039 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:05:32.530038 13039 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:05:32.530815 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:05:32.530913 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:05:32.531002 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:32.531131 13039 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:32.624637 13027 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:05:32.624809 13027 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:32.625281 13027 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:32.626190 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:05:32.626288 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:05:32.626366 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:32.626607 13027 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:05:32.803299 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 261: this message will repeat every 5th retry.
I20260502 14:05:32.903108 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:05:32.903250 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:05:33.509033 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 256: this message will repeat every 5th retry.
I20260502 14:05:35.693552 13115 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:05:35.693724 13115 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:35.694363 13115 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:35.695065 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:05:35.695189 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:05:35.695259 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:35.695396 13115 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:05:37.546492 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 266: this message will repeat every 5th retry.
I20260502 14:05:37.639956 13128 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:37.640139 13128 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:37.640908 13128 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:37.641413 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:05:37.641502 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:05:37.641564 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:37.641705 13128 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:37.905699 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:05:37.905815 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:05:38.401903 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 261: this message will repeat every 5th retry.
I20260502 14:05:39.829833 13193 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:05:39.829998 13193 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:05:39.830641 13193 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:05:39.831166 9562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260502 14:05:39.831821 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:05:39.831964 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:05:39.832036 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:05:39.832185 13193 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:05:40.129875 13104 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:40.130031 13104 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:40.130674 13104 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:05:40.131454 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:05:40.131539 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:05:40.131659 7508 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:40.131803 13104 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:41.851428 13207 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:05:41.851581 13207 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:41.852078 13207 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:41.852859 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:05:41.852957 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:05:41.853027 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:41.853164 13207 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:41.988075 13230 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:05:41.988231 13230 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:05:41.988729 13230 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:05:41.990231 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:05:41.990393 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:05:41.990476 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:05:41.990623 13230 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:05:42.697925 13246 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:05:42.698130 13246 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:05:42.698585 13246 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:05:42.699911 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:05:42.700070 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:05:42.700148 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:05:42.700300 13246 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:05:42.801496 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 271: this message will repeat every 5th retry.
I20260502 14:05:42.908854 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:05:42.908975 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:05:43.423139 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 266: this message will repeat every 5th retry.
I20260502 14:05:43.789220 13258 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:43.789383 13258 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:43.789819 13258 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:43.790517 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:05:43.790644 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:05:43.790760 7508 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:43.790908 13258 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:44.235198 13207 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:05:44.235363 13207 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:44.235766 13207 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:44.236660 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:05:44.236793 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:05:44.236877 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:44.237028 13207 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:46.784588 13206 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:05:46.784775 13206 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:46.785243 13206 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:46.785907 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:05:46.785995 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:05:46.786085 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:46.786234 13206 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:47.256614 13237 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:05:47.256759 13237 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:47.257454 13237 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:05:47.258131 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:05:47.258241 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:05:47.258276 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:05:47.258412 13237 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:05:47.457018 13207 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:05:47.457185 13207 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:47.457618 13207 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:47.458369 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:05:47.458472 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:05:47.458535 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:47.458664 13207 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:05:47.735419 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 276: this message will repeat every 5th retry.
I20260502 14:05:47.911162 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:05:47.911295 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:05:48.702883 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 271: this message will repeat every 5th retry.
I20260502 14:05:50.096890 13336 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:05:50.097033 13336 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:50.097581 13336 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:50.098344 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:05:50.098438 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:05:50.098517 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:50.098730 13336 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:50.120826 13336 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:50.120993 13336 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:05:50.121503 13336 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:05:50.122434 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:05:50.122632 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:05:50.122730 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:50.122912 13336 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:52.913694 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:05:52.913820 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:05:52.945273 7345 heartbeater.cc:646] Failed to heartbeat to 127.6.125.125:46147 (544 consecutive failures): Network error: Failed to ping master at 127.6.125.125:46147: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:05:53.142666 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 281: this message will repeat every 5th retry.
W20260502 14:05:53.174847 7482 heartbeater.cc:646] Failed to heartbeat to 127.6.125.124:43159 (605 consecutive failures): Network error: Failed to ping master at 127.6.125.124:43159: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:05:53.445896 7622 heartbeater.cc:646] Failed to heartbeat to 127.6.125.124:43159 (1208 consecutive failures): Network error: Failed to ping master at 127.6.125.124:43159: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:05:53.446166 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 276: this message will repeat every 5th retry.
I20260502 14:05:54.801987 13420 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:05:54.802160 13420 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:54.802675 13420 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:05:54.803773 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:05:54.804044 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:05:54.804124 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:54.804279 13420 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:55.510043 13275 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:55.510185 13275 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:05:55.510617 13275 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:05:55.511324 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:05:55.511487 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:05:55.511584 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:55.511786 13275 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:57.411885 13420 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:57.412077 13420 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:05:57.412638 13420 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:05:57.413295 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:05:57.413412 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:05:57.413489 7508 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:57.413717 13420 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:05:57.916158 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:05:57.916282 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:05:58.237113 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 281: this message will repeat every 5th retry.
W20260502 14:05:58.390369 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 286: this message will repeat every 5th retry.
I20260502 14:05:59.728219 13336 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:05:59.728389 13336 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:05:59.728869 13336 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:05:59.729905 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:05:59.730041 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:05:59.730108 7511 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:05:59.730296 13336 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:06:00.455955 13500 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:06:00.456086 13500 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:06:00.456666 13500 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:06:00.457261 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260502 14:06:00.457261 9562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:06:00.458144 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:06:00.458278 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:06:00.458335 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:06:00.458472 13500 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:06:00.987269 13237 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:06:00.987425 13237 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:06:00.987993 13237 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:06:00.988790 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:06:00.988936 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:06:00.988984 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:06:00.989164 13237 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:06:02.918548 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:06:02.918763 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260502 14:06:02.946797 13512 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:06:02.946959 13512 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:06:02.947379 13512 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:06:02.948060 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:06:02.948158 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:06:02.948235 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:06:02.948364 13512 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:06:03.099016 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 286: this message will repeat every 5th retry.
I20260502 14:06:03.188468 13512 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:06:03.188634 13512 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:06:03.189155 13512 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:06:03.190039 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:06:03.190150 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:06:03.190215 7508 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:06:03.190362 13512 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:06:03.596954 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 291: this message will repeat every 5th retry.
I20260502 14:06:05.068624 13572 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:06:05.068780 13572 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:06:05.069260 13572 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:06:05.070744 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:06:05.071038 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:06:05.071116 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:06:05.071275 13572 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:06:05.472568 13520 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:06:05.472807 13520 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:06:05.473299 13520 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:06:05.473893 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:06:05.473975 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:06:05.474074 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:06:05.474212 13520 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:06:07.921900 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:06:07.922068 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:06:08.199831 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 291: this message will repeat every 5th retry.
W20260502 14:06:08.621827 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 296: this message will repeat every 5th retry.
I20260502 14:06:09.094229 13512 raft_consensus.cc:493] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:06:09.094393 13512 raft_consensus.cc:515] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } }
I20260502 14:06:09.095136 13512 leader_election.cc:290] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:06:09.096117 7508 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
W20260502 14:06:09.096475 7511 leader_election.cc:343] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 0250841509464228af907fcb4f28dcae
I20260502 14:06:09.096551 7511 leader_election.cc:304] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:06:09.096691 13512 raft_consensus.cc:2749] T 0250841509464228af907fcb4f28dcae P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:06:10.641521 13512 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:06:10.641671 13512 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:06:10.642161 13512 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:06:10.642889 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:06:10.643066 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:06:10.643127 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:06:10.643260 13512 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:06:11.992468 13679 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:06:11.992609 13679 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:06:11.993039 13679 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:06:11.993649 9561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260502 14:06:11.994500 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:06:11.994640 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
I20260502 14:06:11.994717 9561 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:06:11.994850 13679 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260502 14:06:12.690387 13692 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 78b194cad3b9424395e9a403da13ba80)
I20260502 14:06:12.690521 13692 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d590d630acd4892b59504b1c66c4f2d" member_type: VOTER last_known_addr { host: "127.6.125.126" port: 45121 } } peers { permanent_uuid: "78b194cad3b9424395e9a403da13ba80" member_type: VOTER last_known_addr { host: "127.6.125.125" port: 46147 } } peers { permanent_uuid: "a5d257c30a994bfdb03242b10606426f" member_type: VOTER last_known_addr { host: "127.6.125.124" port: 43159 } }
I20260502 14:06:12.690973 13692 leader_election.cc:290] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147), a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159)
W20260502 14:06:12.692456 9561 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a5d257c30a994bfdb03242b10606426f (127.6.125.124:43159): Network error: Client connection negotiation failed: client connection to 127.6.125.124:43159: connect: Connection refused (error 111)
W20260502 14:06:12.692709 9562 leader_election.cc:336] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 78b194cad3b9424395e9a403da13ba80 (127.6.125.125:46147): Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
I20260502 14:06:12.693214 9562 leader_election.cc:304] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d590d630acd4892b59504b1c66c4f2d; no voters: 78b194cad3b9424395e9a403da13ba80, a5d257c30a994bfdb03242b10606426f
I20260502 14:06:12.693396 13692 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 9d590d630acd4892b59504b1c66c4f2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260502 14:06:12.918953 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 296: this message will repeat every 5th retry.
I20260502 14:06:12.924121 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:06:12.924240 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:06:13.305159 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 301: this message will repeat every 5th retry.
I20260502 14:06:14.090230 13512 raft_consensus.cc:493] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:06:14.090392 13512 raft_consensus.cc:515] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:06:14.090847 13512 leader_election.cc:290] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:06:14.091670 7508 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
W20260502 14:06:14.091764 7511 leader_election.cc:343] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: c93263c445ad4872a7e33c9e22709300
I20260502 14:06:14.091851 7511 leader_election.cc:304] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:06:14.092039 13512 raft_consensus.cc:2749] T c93263c445ad4872a7e33c9e22709300 P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:06:14.970130 13731 raft_consensus.cc:493] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1be1472a04ae46e48d852d66903d9c84)
I20260502 14:06:14.970284 13731 raft_consensus.cc:515] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:06:14.970682 13731 leader_election.cc:290] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597)
W20260502 14:06:14.971750 7508 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
W20260502 14:06:14.972302 7511 leader_election.cc:343] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: dea5a68e885548929bced26cf2935d0a
I20260502 14:06:14.972407 7511 leader_election.cc:304] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:06:14.972549 13731 raft_consensus.cc:2749] T dea5a68e885548929bced26cf2935d0a P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:06:17.396117 13730 raft_consensus.cc:493] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:06:17.396291 13730 raft_consensus.cc:515] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:06:17.396689 13730 leader_election.cc:290] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:06:17.397320 7508 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
W20260502 14:06:17.397398 7511 leader_election.cc:343] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 20b64fa709284798944325339eb67a0f
I20260502 14:06:17.397492 7511 leader_election.cc:304] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:06:17.397619 13730 raft_consensus.cc:2749] T 20b64fa709284798944325339eb67a0f P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260502 14:06:17.926366 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:06:17.926491 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:06:18.088779 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 301: this message will repeat every 5th retry.
W20260502 14:06:18.300359 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 306: this message will repeat every 5th retry.
I20260502 14:06:18.359880 13567 raft_consensus.cc:493] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260502 14:06:18.360105 13567 raft_consensus.cc:515] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:06:18.360797 13567 leader_election.cc:290] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873), c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739)
W20260502 14:06:18.361677 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c2964848cb1648a4bc2c1d671cc54f62 (127.6.125.67:34739): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
W20260502 14:06:18.361806 7233 leader_election.cc:343] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: 47e4237f6ea34e2e80d90214a1a7da2f
I20260502 14:06:18.361857 7233 leader_election.cc:304] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dacd17b49934d2c99a91c60aa672f02; no voters: 1be1472a04ae46e48d852d66903d9c84, c2964848cb1648a4bc2c1d671cc54f62
I20260502 14:06:18.362128 13567 raft_consensus.cc:2749] T 47e4237f6ea34e2e80d90214a1a7da2f P 4dacd17b49934d2c99a91c60aa672f02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260502 14:06:19.548080 13771 raft_consensus.cc:493] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dacd17b49934d2c99a91c60aa672f02)
I20260502 14:06:19.548219 13771 raft_consensus.cc:515] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dacd17b49934d2c99a91c60aa672f02" member_type: VOTER last_known_addr { host: "127.6.125.65" port: 37597 } } peers { permanent_uuid: "1be1472a04ae46e48d852d66903d9c84" member_type: VOTER last_known_addr { host: "127.6.125.66" port: 41873 } } peers { permanent_uuid: "c2964848cb1648a4bc2c1d671cc54f62" member_type: VOTER last_known_addr { host: "127.6.125.67" port: 34739 } }
I20260502 14:06:19.548671 13771 leader_election.cc:290] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597), 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873)
W20260502 14:06:19.549371 7508 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
W20260502 14:06:19.549607 7511 leader_election.cc:343] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Not found: Tablet not found: de191f3219804df9bb76291b8ec9e01d
I20260502 14:06:19.549682 7511 leader_election.cc:304] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2964848cb1648a4bc2c1d671cc54f62; no voters: 1be1472a04ae46e48d852d66903d9c84, 4dacd17b49934d2c99a91c60aa672f02
I20260502 14:06:19.549841 13771 raft_consensus.cc:2749] T de191f3219804df9bb76291b8ec9e01d P c2964848cb1648a4bc2c1d671cc54f62 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260502 14:06:22.806474 7511 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 1be1472a04ae46e48d852d66903d9c84 (127.6.125.66:41873): Couldn't send request to peer 1be1472a04ae46e48d852d66903d9c84. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 306: this message will repeat every 5th retry.
I20260502 14:06:22.930164 9544 master_runner.cc:186] Error getting master registration for 127.6.125.125:46147: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111),
I20260502 14:06:22.930328 9544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260502 14:06:23.045499 7508 consensus_peers.cc:597] T 8c10d4c1c67a4d9bb33ebcd1e231ef3a P c2964848cb1648a4bc2c1d671cc54f62 -> Peer 4dacd17b49934d2c99a91c60aa672f02 (127.6.125.65:37597): Couldn't send request to peer 4dacd17b49934d2c99a91c60aa672f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c10d4c1c67a4d9bb33ebcd1e231ef3a. This is attempt 311: this message will repeat every 5th retry.
I20260502 14:06:23.390931 9564 maintenance_manager.cc:419] P 9d590d630acd4892b59504b1c66c4f2d: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4042 bytes on disk
I20260502 14:06:23.394003 9563 maintenance_manager.cc:643] P 9d590d630acd4892b59504b1c66c4f2d: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"dirs.queue_time_us":181,"thread_start_us":173,"threads_started":2,"wal-append.queue_time_us":273}
W20260502 14:06:23.533579 7629 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:06:23.533746 7629 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:06:23.533903 7629 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
W20260502 14:06:23.533972 7629 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
F20260502 14:06:23.544595 7662 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Aborted at 1777730783 (unix time) try "date -d @1777730783" if you are using GNU date ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.548542 7647 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c3fa81d759a04db897e93aa688729318 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.548542 7647 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c3fa81d759a04db897e93aa688729318 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7655 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** SIGABRT (@0x3e8000019f5) received by PID 6645 (TID 0x7f4028f93700) from PID 6645; stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.548542 7647 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c3fa81d759a04db897e93aa688729318 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7655 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7656 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.548542 7647 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c3fa81d759a04db897e93aa688729318 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7655 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7656 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549701 7644 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceee0100290949a6bc0c7926ef8c981e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.548542 7647 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c3fa81d759a04db897e93aa688729318 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7655 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7656 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549701 7644 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceee0100290949a6bc0c7926ef8c981e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550855 7649 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.548542 7647 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c3fa81d759a04db897e93aa688729318 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7655 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7656 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549701 7644 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceee0100290949a6bc0c7926ef8c981e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550855 7649 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550904 7641 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_09d33df61a3f4a6480e2fe299421ae1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7f4048e22980 (unknown) at ??:0
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.548542 7647 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c3fa81d759a04db897e93aa688729318 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7655 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7656 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549701 7644 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceee0100290949a6bc0c7926ef8c981e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550855 7649 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550904 7641 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_09d33df61a3f4a6480e2fe299421ae1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552146 7646 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5bbf52ba925f45dfae2bee0f411a0316 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.548542 7647 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c3fa81d759a04db897e93aa688729318 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7655 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7656 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549701 7644 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceee0100290949a6bc0c7926ef8c981e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550855 7649 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550904 7641 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_09d33df61a3f4a6480e2fe299421ae1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552146 7646 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5bbf52ba925f45dfae2bee0f411a0316 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552196 7640 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_afe9c083ff0b4d1487651533fee05e6b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.548542 7647 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c3fa81d759a04db897e93aa688729318 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7655 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7656 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549701 7644 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceee0100290949a6bc0c7926ef8c981e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550855 7649 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550904 7641 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_09d33df61a3f4a6480e2fe299421ae1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552146 7646 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5bbf52ba925f45dfae2bee0f411a0316 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552196 7640 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_afe9c083ff0b4d1487651533fee05e6b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552281 7650 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.548542 7647 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c3fa81d759a04db897e93aa688729318 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7655 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7656 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549701 7644 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceee0100290949a6bc0c7926ef8c981e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550855 7649 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550904 7641 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_09d33df61a3f4a6480e2fe299421ae1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552146 7646 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5bbf52ba925f45dfae2bee0f411a0316 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552196 7640 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_afe9c083ff0b4d1487651533fee05e6b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552281 7650 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F 2026 05 02 14 : 0606::2323.552312 7639 master-stress-test.cc:328] Check failed: _s.ok() Bad status: :328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)T*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.548542 7647 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c3fa81d759a04db897e93aa688729318 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7655 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7656 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549701 7644 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceee0100290949a6bc0c7926ef8c981e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550855 7649 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550904 7641 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_09d33df61a3f4a6480e2fe299421ae1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552146 7646 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5bbf52ba925f45dfae2bee0f411a0316 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552196 7640 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_afe9c083ff0b4d1487651533fee05e6b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552281 7650 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F 2026 05 02 14 : 0606::2323.552312 7639 master-stress-test.cc:328] Check failed: _s.ok() Bad status: :328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)Timed out: Error creating table default.Table_3803b7a44d4847adabbc5a04821f0382 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552147 7638 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fb7cbf56a40a435aafcbd171a7e85925 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.548542 7647 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c3fa81d759a04db897e93aa688729318 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7655 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7656 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549701 7644 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceee0100290949a6bc0c7926ef8c981e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:461 @ 0x7f40469a0e87 gsignal
47: connect: Connection refused (error 111)F20260502 14:06:23.550855 7649 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550904 7641 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_09d33df61a3f4a6480e2fe299421ae1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552146 7646 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5bbf52ba925f45dfae2bee0f411a0316 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552196 7640 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_afe9c083ff0b4d1487651533fee05e6b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552281 7650 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F 2026 05 02 14 : 0606::2323.552312 7639 master-stress-test.cc:328] Check failed: _s.ok() Bad status: :328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)Timed out: Error creating table default.Table_3803b7a44d4847adabbc5a04821f0382 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552147 7638 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fb7cbf56a40a435aafcbd171a7e85925 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F*** Check failure stack trace: ***
F20260502 14:06:23.544687 7653 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545900 7658 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545943 7659 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546077 7648 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.546162 7645 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_116f97550c144f10bc14cc8c29c1d169 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.545967 7654 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547246 7652 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547302 7661 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547334 7657 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547266 7642 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_438fd981a3264fd58efe636b409acfb1 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.547267 7660 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.548542 7647 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_c3fa81d759a04db897e93aa688729318 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7655 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549676 7656 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.549701 7644 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ceee0100290949a6bc0c7926ef8c981e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550855 7649 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.550904 7641 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_09d33df61a3f4a6480e2fe299421ae1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552146 7646 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_5bbf52ba925f45dfae2bee0f411a0316 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552196 7640 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_afe9c083ff0b4d1487651533fee05e6b on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552281 7650 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F 2026 05 02 14 : 0606::2323.552312 7639 master-stress-test.cc:328] Check failed: _s.ok() Bad status: :328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)Timed out: Error creating table default.Table_3803b7a44d4847adabbc5a04821f0382 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.552147 7638 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fb7cbf56a40a435aafcbd171a7e85925 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)F20260502 14:06:23.553486 7637 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4534fe13c1d94c399d9c725c85deb6d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.6.125.126:45121,127.6.125.125:46147,127.6.125.124:43159, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.6.125.125:46147: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7f40469a27f1 abort at ??:0
@ 0x7f4047809dcd google::LogMessage::Fail() at ??:0
@ 0x7f404780db93 google::LogMessage::SendToLog() at ??:0
@ 0x7f40478097cc google::LogMessage::Flush() at ??:0
@ 0x7f404780af59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x561b01986a61 kudu::MasterStressTest::ReplaceTabletThread() at ??:0
@ 0x561b019986fc std::__invoke_impl<>() at ??:0
@ 0x561b01996438 std::__invoke<>() at ??:0
@ 0x561b0199da89 _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTcl8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at ??:0
@ 0x561b0199ca8d std::thread::_Invoker<>::operator()() at ??:0
@ 0x561b0199b80a std::thread::_State_impl<>::_M_run() at ??:0
@ 0x7f40470286df (unknown) at ??:0
@ 0x7f4048e176db start_thread at ??:0
@ 0x7f4046a8361f clone at ??:0