Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
2026-04-29T08:00:12Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-04-29T08:00:12Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-task0BSNFf/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-task0BSNFf/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/security.properties
2026-04-29 08:00:19: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-task0BSNFf/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-task0BSNFf/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260429 08:00:27.551388 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.62:41885
--webserver_interface=127.1.14.62
--webserver_port=0
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260429 08:00:27.648648 1364 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:27.648861 1364 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:27.648900 1364 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:27.652218 1364 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 08:00:27.652282 1364 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:27.652302 1364 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 08:00:27.652320 1364 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 08:00:27.656152 1364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.62:41885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.14.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.1364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:27.657225 1364 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:27.658321 1364 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:27.663808 1372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:27.663761 1369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:27.663864 1364 server_base.cc:1061] running on GCE node
W20260429 08:00:27.663761 1370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:27.664484 1364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:27.665328 1364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:27.666476 1364 hybrid_clock.cc:648] HybridClock initialized: now 1777449627666454 us; error 33 us; skew 500 ppm
I20260429 08:00:27.668128 1364 webserver.cc:492] Webserver started at http://127.1.14.62:35601/ using document root <none> and password file <none>
I20260429 08:00:27.668751 1364 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:27.668803 1364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:27.669003 1364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 08:00:27.670549 1364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/instance:
uuid: "d7c20d1745e54a9db1e0082a48ed06e4"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:27.671039 1364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal/instance:
uuid: "d7c20d1745e54a9db1e0082a48ed06e4"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:27.674281 1364 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260429 08:00:27.676409 1378 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:27.677368 1364 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:27.677459 1364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
uuid: "d7c20d1745e54a9db1e0082a48ed06e4"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:27.677570 1364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:27.690408 1364 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:27.691037 1364 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:27.691233 1364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:27.698161 1364 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.62:41885
I20260429 08:00:27.698167 1430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.62:41885 every 8 connection(s)
I20260429 08:00:27.699175 1364 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/info.pb
I20260429 08:00:27.701987 1431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:27.704867 1431 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } has no permanent_uuid. Determining permanent_uuid...
I20260429 08:00:27.707079 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 1364
I20260429 08:00:27.707194 1080 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal/instance
I20260429 08:00:27.708487 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.61:33847
--webserver_interface=127.1.14.61
--webserver_port=0
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260429 08:00:27.715870 1431 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } has no permanent_uuid. Determining permanent_uuid...
W20260429 08:00:27.716710 1379 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
W20260429 08:00:27.717541 1431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.14.61:33847: Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:27.766770 1431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } attempt: 1
W20260429 08:00:27.768234 1431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.14.61:33847: Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
W20260429 08:00:27.807180 1434 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:27.807439 1434 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:27.807519 1434 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:27.810708 1434 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 08:00:27.810796 1434 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:27.810832 1434 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 08:00:27.810889 1434 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 08:00:27.814749 1434 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.61:33847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.14.61
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.1434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:27.815793 1434 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:27.816882 1434 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:27.821936 1440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:27.822016 1441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:27.821970 1443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:27.822309 1434 server_base.cc:1061] running on GCE node
I20260429 08:00:27.822788 1434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:27.823563 1434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:27.824702 1434 hybrid_clock.cc:648] HybridClock initialized: now 1777449627824683 us; error 30 us; skew 500 ppm
I20260429 08:00:27.826308 1434 webserver.cc:492] Webserver started at http://127.1.14.61:38285/ using document root <none> and password file <none>
I20260429 08:00:27.826781 1434 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:27.826828 1434 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:27.826979 1434 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 08:00:27.828333 1434 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/instance:
uuid: "f1e6af049ae04c6e98cb5e609f9be472"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:27.828835 1434 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal/instance:
uuid: "f1e6af049ae04c6e98cb5e609f9be472"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:27.831748 1434 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20260429 08:00:27.833777 1449 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:27.834779 1434 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:27.834935 1434 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
uuid: "f1e6af049ae04c6e98cb5e609f9be472"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:27.835021 1434 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:27.836369 1431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } attempt: 2
W20260429 08:00:27.837646 1431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.14.61:33847: Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:27.846930 1434 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:27.847509 1434 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:27.847679 1434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:27.854692 1434 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.61:33847
I20260429 08:00:27.854704 1501 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.61:33847 every 8 connection(s)
I20260429 08:00:27.855976 1434 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
I20260429 08:00:27.859167 1502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:27.861855 1502 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } has no permanent_uuid. Determining permanent_uuid...
I20260429 08:00:27.863303 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 1434
I20260429 08:00:27.863409 1080 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal/instance
I20260429 08:00:27.864110 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.60:41737
--webserver_interface=127.1.14.60
--webserver_port=0
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260429 08:00:27.870218 1502 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } has no permanent_uuid. Determining permanent_uuid...
I20260429 08:00:27.876235 1502 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } has no permanent_uuid. Determining permanent_uuid...
W20260429 08:00:27.876931 1453 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
W20260429 08:00:27.877700 1502 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.14.60:41737: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:27.926939 1502 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } attempt: 1
W20260429 08:00:27.928354 1502 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.14.60:41737: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:27.928777 1431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } attempt: 3
I20260429 08:00:27.933249 1431 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } has no permanent_uuid. Determining permanent_uuid...
W20260429 08:00:27.934515 1431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.14.60:41737: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
W20260429 08:00:27.964260 1504 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:27.964450 1504 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:27.964486 1504 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260429 08:00:27.965699 1431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } attempt: 1
W20260429 08:00:27.967113 1431 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.14.60:41737: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
W20260429 08:00:27.968011 1504 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 08:00:27.968055 1504 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:27.968075 1504 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 08:00:27.968091 1504 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 08:00:27.971692 1504 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.60:41737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.14.60
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.1504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:27.972724 1504 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:27.973695 1504 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:27.978662 1511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:27.978665 1512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:27.978855 1514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:27.978715 1504 server_base.cc:1061] running on GCE node
I20260429 08:00:27.979272 1504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:27.980060 1504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:27.981200 1504 hybrid_clock.cc:648] HybridClock initialized: now 1777449627981179 us; error 34 us; skew 500 ppm
I20260429 08:00:27.982774 1504 webserver.cc:492] Webserver started at http://127.1.14.60:45447/ using document root <none> and password file <none>
I20260429 08:00:27.983316 1504 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:27.983367 1504 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:27.983579 1504 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 08:00:27.985069 1504 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/instance:
uuid: "cd076a6196ef424a813003c9c5d53d42"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:27.985494 1504 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal/instance:
uuid: "cd076a6196ef424a813003c9c5d53d42"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:27.988457 1504 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260429 08:00:27.990443 1520 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:27.991291 1504 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:27.991410 1504 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
uuid: "cd076a6196ef424a813003c9c5d53d42"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:27.991492 1504 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:27.996521 1502 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } attempt: 2
W20260429 08:00:27.997736 1502 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.14.60:41737: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:28.015717 1504 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:28.016342 1504 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:28.016486 1504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:28.023185 1504 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.60:41737
I20260429 08:00:28.023185 1572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.60:41737 every 8 connection(s)
I20260429 08:00:28.024271 1504 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/info.pb
I20260429 08:00:28.026847 1573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:28.029664 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 1504
I20260429 08:00:28.029754 1080 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal/instance
I20260429 08:00:28.029639 1573 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } has no permanent_uuid. Determining permanent_uuid...
I20260429 08:00:28.038759 1573 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } has no permanent_uuid. Determining permanent_uuid...
I20260429 08:00:28.042282 1431 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } attempt: 2
I20260429 08:00:28.043535 1573 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } has no permanent_uuid. Determining permanent_uuid...
I20260429 08:00:28.050710 1431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Bootstrap starting.
I20260429 08:00:28.050709 1573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Bootstrap starting.
I20260429 08:00:28.053336 1573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:28.053336 1431 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:28.054693 1431 log.cc:826] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:28.054693 1573 log.cc:826] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:28.056465 1431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: No bootstrap required, opened a new log
I20260429 08:00:28.056465 1573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: No bootstrap required, opened a new log
I20260429 08:00:28.059499 1431 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:28.059504 1573 raft_consensus.cc:359] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:28.059667 1573 raft_consensus.cc:385] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:28.059736 1573 raft_consensus.cc:740] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd076a6196ef424a813003c9c5d53d42, State: Initialized, Role: FOLLOWER
I20260429 08:00:28.059791 1431 raft_consensus.cc:385] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:28.059895 1431 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7c20d1745e54a9db1e0082a48ed06e4, State: Initialized, Role: FOLLOWER
I20260429 08:00:28.060289 1431 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:28.060289 1573 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:28.060774 1584 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:28.060823 1583 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:28.060983 1583 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:28.060998 1584 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:28.061457 1573 sys_catalog.cc:565] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: configured and running, proceeding with master startup.
I20260429 08:00:28.061457 1431 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: configured and running, proceeding with master startup.
W20260429 08:00:28.067842 1608 catalog_manager.cc:1568] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260429 08:00:28.067952 1608 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260429 08:00:28.068208 1612 catalog_manager.cc:1568] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260429 08:00:28.068305 1612 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260429 08:00:28.067706 1364 master_runner.cc:186] Error getting master registration for 127.1.14.61:33847: OK, instance_id { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" instance_seqno: 1777449627852418 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260429 08:00:28.070029 1364 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:28.071944 1504 master_runner.cc:186] Error getting master registration for 127.1.14.61:33847: OK, instance_id { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" instance_seqno: 1777449627852418 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260429 08:00:28.074203 1504 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:28.088891 1502 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } attempt: 3
I20260429 08:00:28.098006 1502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Bootstrap starting.
I20260429 08:00:28.103080 1502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:28.104425 1502 log.cc:826] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:28.127921 1502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: No bootstrap required, opened a new log
I20260429 08:00:28.131510 1502 raft_consensus.cc:359] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:28.131711 1502 raft_consensus.cc:385] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:28.131775 1502 raft_consensus.cc:740] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1e6af049ae04c6e98cb5e609f9be472, State: Initialized, Role: FOLLOWER
I20260429 08:00:28.132272 1502 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:28.133704 1502 sys_catalog.cc:565] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: configured and running, proceeding with master startup.
I20260429 08:00:28.145996 1434 master_runner.cc:263] No leader master found from master f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:28.146071 1434 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:28.146391 1619 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:28.146600 1619 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
W20260429 08:00:28.178544 1633 catalog_manager.cc:1568] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260429 08:00:28.178728 1633 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260429 08:00:28.192543 1384 tablet.cc:2404] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260429 08:00:28.267633 1526 tablet.cc:2404] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260429 08:00:28.348980 1455 tablet.cc:2404] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260429 08:00:28.465237 1583 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:28.465396 1583 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:28.466288 1583 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
I20260429 08:00:28.466795 1405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd076a6196ef424a813003c9c5d53d42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" is_pre_election: true
I20260429 08:00:28.466804 1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd076a6196ef424a813003c9c5d53d42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1e6af049ae04c6e98cb5e609f9be472" is_pre_election: true
I20260429 08:00:28.467126 1405 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd076a6196ef424a813003c9c5d53d42 in term 0.
I20260429 08:00:28.467150 1476 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd076a6196ef424a813003c9c5d53d42 in term 0.
I20260429 08:00:28.467536 1524 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4; no voters:
I20260429 08:00:28.467760 1583 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:28.467829 1583 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:28.467885 1583 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:28.468986 1583 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:28.469357 1583 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 1 election: Requested vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
I20260429 08:00:28.469590 1405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd076a6196ef424a813003c9c5d53d42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c20d1745e54a9db1e0082a48ed06e4"
I20260429 08:00:28.469703 1405 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:28.469702 1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd076a6196ef424a813003c9c5d53d42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1e6af049ae04c6e98cb5e609f9be472"
I20260429 08:00:28.469787 1476 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:28.470522 1476 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd076a6196ef424a813003c9c5d53d42 in term 1.
I20260429 08:00:28.470546 1405 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd076a6196ef424a813003c9c5d53d42 in term 1.
I20260429 08:00:28.470757 1521 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, f1e6af049ae04c6e98cb5e609f9be472; no voters:
I20260429 08:00:28.470930 1583 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:28.471154 1583 raft_consensus.cc:697] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 1 LEADER]: Becoming Leader. State: Replica: cd076a6196ef424a813003c9c5d53d42, State: Running, Role: LEADER
I20260429 08:00:28.471419 1583 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:28.473196 1636 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd076a6196ef424a813003c9c5d53d42. Latest consensus state: current_term: 1 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:28.473295 1636 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:28.473642 1638 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260429 08:00:28.474527 1638 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260429 08:00:28.478492 1405 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 1 FOLLOWER]: Refusing update from remote peer cd076a6196ef424a813003c9c5d53d42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260429 08:00:28.478492 1476 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 1 FOLLOWER]: Refusing update from remote peer cd076a6196ef424a813003c9c5d53d42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260429 08:00:28.479048 1636 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:28.479230 1583 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:28.482105 1619 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd076a6196ef424a813003c9c5d53d42. Latest consensus state: current_term: 1 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:28.482213 1619 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:28.482734 1584 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd076a6196ef424a813003c9c5d53d42. Latest consensus state: current_term: 1 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:28.482817 1584 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:28.484619 1636 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:28.484716 1636 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:28.484972 1583 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:28.485070 1583 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:28.485150 1584 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:28.485236 1584 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:28.485359 1641 mvcc.cc:204] Tried to move back new op lower bound from 7280433678241853440 to 7280433678221205504. Current Snapshot: MvccSnapshot[applied={T|T < 7280433678241853440}]
I20260429 08:00:28.486049 1619 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:28.486160 1619 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:28.487177 1638 catalog_manager.cc:1357] Generated new cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:28.487259 1638 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260429 08:00:28.495195 1638 catalog_manager.cc:1380] Generated new certificate authority record
I20260429 08:00:28.495931 1638 catalog_manager.cc:1514] Loading token signing keys...
I20260429 08:00:28.512269 1638 catalog_manager.cc:6044] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Generated new TSK 0
I20260429 08:00:28.513386 1638 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260429 08:00:28.513826 1638 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260429 08:00:28.514186 1638 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: -1
I20260429 08:00:28.535254 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.14.1:0
--local_ip_for_outbound_sockets=127.1.14.1
--webserver_interface=127.1.14.1
--webserver_port=0
--tserver_master_addrs=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260429 08:00:28.633455 1649 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:28.633673 1649 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:28.633745 1649 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:28.637151 1649 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:28.637295 1649 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.14.1
I20260429 08:00:28.640950 1649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.14.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.14.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--never_fsync=true
--heap_profile_path=/tmp/kudu.1649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.14.1
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:28.641924 1649 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:28.642954 1649 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:28.648917 1657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:28.648922 1654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:28.649048 1655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:28.649034 1649 server_base.cc:1061] running on GCE node
I20260429 08:00:28.649499 1649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:28.649987 1649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:28.651146 1649 hybrid_clock.cc:648] HybridClock initialized: now 1777449628651125 us; error 33 us; skew 500 ppm
I20260429 08:00:28.652766 1649 webserver.cc:492] Webserver started at http://127.1.14.1:39793/ using document root <none> and password file <none>
I20260429 08:00:28.653293 1649 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:28.653368 1649 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:28.653568 1649 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 08:00:28.654987 1649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/data/instance:
uuid: "6441a846e67a46159cef1413b6d06337"
format_stamp: "Formatted at 2026-04-29 08:00:28 on dist-test-slave-lllb"
I20260429 08:00:28.655428 1649 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/instance:
uuid: "6441a846e67a46159cef1413b6d06337"
format_stamp: "Formatted at 2026-04-29 08:00:28 on dist-test-slave-lllb"
I20260429 08:00:28.658476 1649 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260429 08:00:28.660485 1663 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:28.661422 1649 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260429 08:00:28.661643 1649 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal
uuid: "6441a846e67a46159cef1413b6d06337"
format_stamp: "Formatted at 2026-04-29 08:00:28 on dist-test-slave-lllb"
I20260429 08:00:28.661738 1649 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:28.672358 1649 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:28.672955 1649 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:28.673132 1649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:28.673681 1649 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 08:00:28.674613 1649 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 08:00:28.674659 1649 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:28.674696 1649 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 08:00:28.674711 1649 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:28.683302 1649 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.1:40803
I20260429 08:00:28.683329 1776 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.1:40803 every 8 connection(s)
I20260429 08:00:28.684172 1649 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/data/info.pb
I20260429 08:00:28.690176 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 1649
I20260429 08:00:28.690299 1080 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/instance
I20260429 08:00:28.694082 1779 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:28.694120 1777 heartbeater.cc:344] Connected to a master server at 127.1.14.60:41737
I20260429 08:00:28.694160 1778 heartbeater.cc:344] Connected to a master server at 127.1.14.62:41885
I20260429 08:00:28.694310 1777 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:28.694311 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.14.2:0
--local_ip_for_outbound_sockets=127.1.14.2
--webserver_interface=127.1.14.2
--webserver_port=0
--tserver_master_addrs=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260429 08:00:28.694309 1778 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:28.694849 1778 heartbeater.cc:507] Master 127.1.14.62:41885 requested a full tablet report, sending...
I20260429 08:00:28.694852 1777 heartbeater.cc:507] Master 127.1.14.60:41737 requested a full tablet report, sending...
I20260429 08:00:28.694310 1779 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:28.695549 1779 heartbeater.cc:507] Master 127.1.14.61:33847 requested a full tablet report, sending...
I20260429 08:00:28.696554 1537 ts_manager.cc:194] Registered new tserver with Master: 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:28.696554 1466 ts_manager.cc:194] Registered new tserver with Master: 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:28.697152 1395 ts_manager.cc:194] Registered new tserver with Master: 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:28.698109 1537 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.14.1:60091
W20260429 08:00:28.794477 1787 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:28.794708 1787 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:28.794781 1787 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:28.798056 1787 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:28.798218 1787 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.14.2
I20260429 08:00:28.801920 1787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.14.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.14.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--never_fsync=true
--heap_profile_path=/tmp/kudu.1787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.14.2
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:28.802969 1787 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:28.804031 1787 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:28.810138 1793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:28.810148 1792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:28.810158 1795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:28.810446 1787 server_base.cc:1061] running on GCE node
I20260429 08:00:28.810817 1787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:28.811342 1787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:28.812507 1787 hybrid_clock.cc:648] HybridClock initialized: now 1777449628812486 us; error 44 us; skew 500 ppm
I20260429 08:00:28.814201 1787 webserver.cc:492] Webserver started at http://127.1.14.2:36929/ using document root <none> and password file <none>
I20260429 08:00:28.814767 1787 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:28.814848 1787 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:28.815052 1787 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 08:00:28.816515 1787 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/data/instance:
uuid: "353e59f343974ee68738535fb9029d30"
format_stamp: "Formatted at 2026-04-29 08:00:28 on dist-test-slave-lllb"
I20260429 08:00:28.817008 1787 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/instance:
uuid: "353e59f343974ee68738535fb9029d30"
format_stamp: "Formatted at 2026-04-29 08:00:28 on dist-test-slave-lllb"
I20260429 08:00:28.819919 1787 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260429 08:00:28.821993 1801 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:28.822908 1787 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:28.823024 1787 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal
uuid: "353e59f343974ee68738535fb9029d30"
format_stamp: "Formatted at 2026-04-29 08:00:28 on dist-test-slave-lllb"
I20260429 08:00:28.823113 1787 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:28.838812 1787 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:28.839370 1787 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:28.839551 1787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:28.840083 1787 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 08:00:28.841090 1787 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 08:00:28.841163 1787 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:28.841231 1787 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 08:00:28.841276 1787 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:28.849859 1787 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.2:43223
I20260429 08:00:28.849908 1914 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.2:43223 every 8 connection(s)
I20260429 08:00:28.850773 1787 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/data/info.pb
I20260429 08:00:28.851383 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 1787
I20260429 08:00:28.851495 1080 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/instance
I20260429 08:00:28.854560 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.14.3:0
--local_ip_for_outbound_sockets=127.1.14.3
--webserver_interface=127.1.14.3
--webserver_port=0
--tserver_master_addrs=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260429 08:00:28.861030 1916 heartbeater.cc:344] Connected to a master server at 127.1.14.62:41885
I20260429 08:00:28.861161 1917 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:28.861280 1916 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:28.861280 1917 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:28.861866 1917 heartbeater.cc:507] Master 127.1.14.61:33847 requested a full tablet report, sending...
I20260429 08:00:28.861867 1916 heartbeater.cc:507] Master 127.1.14.62:41885 requested a full tablet report, sending...
I20260429 08:00:28.862798 1915 heartbeater.cc:344] Connected to a master server at 127.1.14.60:41737
I20260429 08:00:28.862879 1915 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:28.862931 1466 ts_manager.cc:194] Registered new tserver with Master: 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:28.863034 1915 heartbeater.cc:507] Master 127.1.14.60:41737 requested a full tablet report, sending...
I20260429 08:00:28.863116 1395 ts_manager.cc:194] Registered new tserver with Master: 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:28.863763 1537 ts_manager.cc:194] Registered new tserver with Master: 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:28.864370 1537 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.14.2:56411
W20260429 08:00:28.958305 1922 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:28.958531 1922 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:28.958607 1922 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:28.961794 1922 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:28.961951 1922 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.14.3
I20260429 08:00:28.966214 1922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.14.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.14.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--never_fsync=true
--heap_profile_path=/tmp/kudu.1922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.14.3
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:28.967267 1922 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:28.968322 1922 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:28.974336 1927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:28.974337 1930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:28.974444 1928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:28.974553 1922 server_base.cc:1061] running on GCE node
I20260429 08:00:28.974915 1922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:28.975404 1922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:28.976626 1922 hybrid_clock.cc:648] HybridClock initialized: now 1777449628976611 us; error 29 us; skew 500 ppm
I20260429 08:00:28.978220 1922 webserver.cc:492] Webserver started at http://127.1.14.3:42857/ using document root <none> and password file <none>
I20260429 08:00:28.978791 1922 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:28.978865 1922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:28.979064 1922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260429 08:00:28.980432 1922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/data/instance:
uuid: "873f2b4fab6f42738b2d41b4608a592a"
format_stamp: "Formatted at 2026-04-29 08:00:28 on dist-test-slave-lllb"
I20260429 08:00:28.980895 1922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/instance:
uuid: "873f2b4fab6f42738b2d41b4608a592a"
format_stamp: "Formatted at 2026-04-29 08:00:28 on dist-test-slave-lllb"
I20260429 08:00:28.983917 1922 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260429 08:00:28.985872 1936 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:28.986785 1922 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:28.986877 1922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal
uuid: "873f2b4fab6f42738b2d41b4608a592a"
format_stamp: "Formatted at 2026-04-29 08:00:28 on dist-test-slave-lllb"
I20260429 08:00:28.986981 1922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:29.013625 1941 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd076a6196ef424a813003c9c5d53d42)
I20260429 08:00:29.013811 1922 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:29.013773 1941 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:29.014490 1922 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:29.014665 1922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:29.014801 1941 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
I20260429 08:00:29.015307 1405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1e6af049ae04c6e98cb5e609f9be472" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" is_pre_election: true
I20260429 08:00:29.015414 1922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260429 08:00:29.015436 1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1e6af049ae04c6e98cb5e609f9be472" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd076a6196ef424a813003c9c5d53d42" is_pre_election: true
I20260429 08:00:29.015866 1453 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:29.016089 1941 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:29.016690 1922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260429 08:00:29.016749 1922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:29.016817 1922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260429 08:00:29.016855 1922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:29.026216 1922 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.3:33279
I20260429 08:00:29.026341 2050 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.3:33279 every 8 connection(s)
I20260429 08:00:29.027208 1922 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/data/info.pb
I20260429 08:00:29.032035 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 1922
I20260429 08:00:29.032151 1080 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/instance
I20260429 08:00:29.036608 2053 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:29.036837 2053 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:29.037389 2053 heartbeater.cc:507] Master 127.1.14.61:33847 requested a full tablet report, sending...
I20260429 08:00:29.037941 2051 heartbeater.cc:344] Connected to a master server at 127.1.14.60:41737
I20260429 08:00:29.038013 2051 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:29.038182 2051 heartbeater.cc:507] Master 127.1.14.60:41737 requested a full tablet report, sending...
I20260429 08:00:29.038452 1465 ts_manager.cc:194] Registered new tserver with Master: 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:29.038748 1537 ts_manager.cc:194] Registered new tserver with Master: 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:29.039398 1537 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.14.3:52527
I20260429 08:00:29.039625 2052 heartbeater.cc:344] Connected to a master server at 127.1.14.62:41885
I20260429 08:00:29.039695 2052 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:29.039860 2052 heartbeater.cc:507] Master 127.1.14.62:41885 requested a full tablet report, sending...
I20260429 08:00:29.040439 1395 ts_manager.cc:194] Registered new tserver with Master: 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:29.052184 1080 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20260429 08:00:29.065279 1080 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task0BSNFf/build/debug/bin/kudu with pid 1504
I20260429 08:00:29.069283 1608 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:29.069348 1608 catalog_manager.cc:1562] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: loading cluster ID for follower catalog manager: success
I20260429 08:00:29.071761 1608 catalog_manager.cc:1584] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: acquiring CA information for follower catalog manager: success
I20260429 08:00:29.073084 1608 catalog_manager.cc:1612] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260429 08:00:29.074047 2061 connection.cc:570] client connection to 127.1.14.60:41737 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:29.074570 2061 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.14.60:41737)
I20260429 08:00:29.179819 1633 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:29.179893 1633 catalog_manager.cc:1562] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: loading cluster ID for follower catalog manager: success
I20260429 08:00:29.181619 1633 catalog_manager.cc:1584] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: acquiring CA information for follower catalog manager: success
I20260429 08:00:29.182682 1633 catalog_manager.cc:1612] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260429 08:00:29.199827 1777 heartbeater.cc:499] Master 127.1.14.60:41737 was elected leader, sending a full tablet report...
W20260429 08:00:29.200711 1777 heartbeater.cc:646] Failed to heartbeat to 127.1.14.60:41737 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:29.365948 1915 heartbeater.cc:499] Master 127.1.14.60:41737 was elected leader, sending a full tablet report...
W20260429 08:00:29.366874 1915 heartbeater.cc:646] Failed to heartbeat to 127.1.14.60:41737 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:29.490664 2099 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd076a6196ef424a813003c9c5d53d42)
I20260429 08:00:29.490799 2099 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:29.491699 2099 leader_election.cc:290] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
I20260429 08:00:29.492077 1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1e6af049ae04c6e98cb5e609f9be472" is_pre_election: true
W20260429 08:00:29.492903 1382 leader_election.cc:336] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:29.492988 1382 leader_election.cc:304] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7c20d1745e54a9db1e0082a48ed06e4; no voters: cd076a6196ef424a813003c9c5d53d42, f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:29.493206 2099 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:29.527736 2102 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd076a6196ef424a813003c9c5d53d42)
I20260429 08:00:29.527863 2102 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:29.528345 2102 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
I20260429 08:00:29.528781 1405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1e6af049ae04c6e98cb5e609f9be472" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" is_pre_election: true
I20260429 08:00:29.528945 1405 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1e6af049ae04c6e98cb5e609f9be472 in term 1.
I20260429 08:00:29.529269 1453 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7c20d1745e54a9db1e0082a48ed06e4, f1e6af049ae04c6e98cb5e609f9be472; no voters:
I20260429 08:00:29.529409 2102 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260429 08:00:29.529474 2102 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd076a6196ef424a813003c9c5d53d42)
I20260429 08:00:29.529523 2102 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 1 FOLLOWER]: Advancing to term 2
W20260429 08:00:29.529881 1453 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:29.530501 2102 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:29.530794 2102 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 2 election: Requested vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
I20260429 08:00:29.531060 1405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1e6af049ae04c6e98cb5e609f9be472" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7c20d1745e54a9db1e0082a48ed06e4"
I20260429 08:00:29.531250 1405 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 1 FOLLOWER]: Advancing to term 2
I20260429 08:00:29.532377 1405 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1e6af049ae04c6e98cb5e609f9be472 in term 2.
W20260429 08:00:29.532469 1453 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:29.532660 1453 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7c20d1745e54a9db1e0082a48ed06e4, f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42
I20260429 08:00:29.532820 2102 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 2 FOLLOWER]: Leader election won for term 2
I20260429 08:00:29.532959 2102 raft_consensus.cc:697] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 2 LEADER]: Becoming Leader. State: Replica: f1e6af049ae04c6e98cb5e609f9be472, State: Running, Role: LEADER
I20260429 08:00:29.533206 2102 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:29.534446 2105 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1e6af049ae04c6e98cb5e609f9be472. Latest consensus state: current_term: 2 leader_uuid: "f1e6af049ae04c6e98cb5e609f9be472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:29.534534 2105 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:29.534770 2107 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260429 08:00:29.535578 2107 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260429 08:00:29.535938 2107 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:29.535981 2107 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260429 08:00:29.536502 2107 catalog_manager.cc:1514] Loading token signing keys...
I20260429 08:00:29.536885 2107 catalog_manager.cc:6055] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Loaded TSK: 0
I20260429 08:00:29.537454 2107 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260429 08:00:29.537811 2107 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260429 08:00:29.538129 2107 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: -1
I20260429 08:00:29.540836 2051 heartbeater.cc:499] Master 127.1.14.60:41737 was elected leader, sending a full tablet report...
W20260429 08:00:29.541687 2051 heartbeater.cc:646] Failed to heartbeat to 127.1.14.60:41737 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:29.544860 1466 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_9b98ec36c0514c4e9e1e5d745435032f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:29.545284 1460 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_5ce59414814f4106ae9ad5a804275bb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:29.545054 1463 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_ac03de9e4e6343c89e902b1c64baee24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:29.545089 1462 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_a5c75ef558e9422c9e29eaa5ad3e92ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:29.545192 1461 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_5d064684efbd44ca80193c9417a8308f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:29.545531 1457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_a7449fdac83e405daed3c36aecdd0b32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:29.544857 1465 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_5bbc20bf027b4b4eb99c583f351cf1b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:29.545264 1459 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_ec6b6e2df1d545c78484235081b96327"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:29.545286 1458 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_34261e3d16e14d888f3f3fd3c436b4ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:29.544986 1464 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_2aa9e902a68149cebca957e279cc82c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260429 08:00:29.578090 1466 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9b98ec36c0514c4e9e1e5d745435032f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:29.581867 1463 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ac03de9e4e6343c89e902b1c64baee24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:29.582022 1461 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5d064684efbd44ca80193c9417a8308f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:29.581882 1465 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5bbc20bf027b4b4eb99c583f351cf1b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:29.582741 1460 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5ce59414814f4106ae9ad5a804275bb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:29.581867 1457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a7449fdac83e405daed3c36aecdd0b32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:29.583331 1462 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a5c75ef558e9422c9e29eaa5ad3e92ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:29.583897 1459 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ec6b6e2df1d545c78484235081b96327 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:29.584502 1458 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_34261e3d16e14d888f3f3fd3c436b4ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:29.582044 1464 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2aa9e902a68149cebca957e279cc82c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260429 08:00:29.587632 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.60:41737
--webserver_interface=127.1.14.60
--webserver_port=45447
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260429 08:00:29.726342 2109 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:29.727015 2109 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:29.727205 2109 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:29.732023 2109 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 08:00:29.732247 2109 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:29.732342 2109 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 08:00:29.732415 2109 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 08:00:29.738528 2109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.60:41737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.14.60
--webserver_port=45447
--never_fsync=true
--heap_profile_path=/tmp/kudu.2109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:29.740244 2109 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:29.741783 2109 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:29.748854 2116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:29.748862 2117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:29.749418 2109 server_base.cc:1061] running on GCE node
W20260429 08:00:29.752251 2119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:29.753007 2109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:29.754184 2109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:29.757452 2109 hybrid_clock.cc:648] HybridClock initialized: now 1777449629757424 us; error 50 us; skew 500 ppm
I20260429 08:00:29.759793 2109 webserver.cc:492] Webserver started at http://127.1.14.60:45447/ using document root <none> and password file <none>
I20260429 08:00:29.760510 2109 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:29.760627 2109 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:29.764907 2109 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260429 08:00:29.767294 2125 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:29.768435 2109 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:29.768546 2109 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
uuid: "cd076a6196ef424a813003c9c5d53d42"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:29.769061 2109 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:29.784981 2109 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:29.785725 2109 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:29.785941 2109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:29.794194 2109 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.60:41737
I20260429 08:00:29.795473 2109 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/info.pb
I20260429 08:00:29.796978 2177 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.60:41737 every 8 connection(s)
I20260429 08:00:29.801442 2178 sys_catalog.cc:263] Verifying existing consensus state
I20260429 08:00:29.803408 2178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Bootstrap starting.
I20260429 08:00:29.804461 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 2109
I20260429 08:00:29.811640 2178 log.cc:826] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:29.819608 2178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 08:00:29.822358 2178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Bootstrap complete.
I20260429 08:00:29.825906 2178 raft_consensus.cc:359] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:29.830225 2178 raft_consensus.cc:740] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd076a6196ef424a813003c9c5d53d42, State: Initialized, Role: FOLLOWER
I20260429 08:00:29.830822 2178 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:29.832157 2178 sys_catalog.cc:565] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: configured and running, proceeding with master startup.
I20260429 08:00:29.835728 2182 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:29.835855 2182 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:29.859843 2196 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:29.859937 2196 catalog_manager.cc:1562] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: loading cluster ID for follower catalog manager: success
I20260429 08:00:29.863405 2196 catalog_manager.cc:1584] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: acquiring CA information for follower catalog manager: success
I20260429 08:00:29.864701 2196 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260429 08:00:29.892983 1915 heartbeater.cc:344] Connected to a master server at 127.1.14.60:41737
I20260429 08:00:29.893129 1915 heartbeater.cc:499] Master 127.1.14.60:41737 was elected leader, sending a full tablet report...
I20260429 08:00:29.894547 2142 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "353e59f343974ee68738535fb9029d30" instance_seqno: 1777449628847581) as {username='slave'} at 127.1.14.2:50433; Asking this server to re-register.
I20260429 08:00:29.895176 1915 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:29.896199 2142 ts_manager.cc:194] Registered new tserver with Master: 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:30.037151 2152 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 1 FOLLOWER]: Advancing to term 2
I20260429 08:00:30.039608 2152 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 2 FOLLOWER]: Refusing update from remote peer f1e6af049ae04c6e98cb5e609f9be472: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260429 08:00:30.040195 2105 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260429 08:00:30.041079 2053 heartbeater.cc:499] Master 127.1.14.61:33847 was elected leader, sending a full tablet report...
I20260429 08:00:30.041975 2182 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1e6af049ae04c6e98cb5e609f9be472. Latest consensus state: current_term: 2 leader_uuid: "f1e6af049ae04c6e98cb5e609f9be472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:30.042125 2182 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:30.056090 2051 heartbeater.cc:344] Connected to a master server at 127.1.14.60:41737
I20260429 08:00:30.056213 2051 heartbeater.cc:499] Master 127.1.14.60:41737 was elected leader, sending a full tablet report...
I20260429 08:00:30.056763 2142 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" instance_seqno: 1777449629023571) as {username='slave'} at 127.1.14.3:55107; Asking this server to re-register.
I20260429 08:00:30.057196 2051 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:30.057880 2142 ts_manager.cc:194] Registered new tserver with Master: 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.060070 2105 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f1e6af049ae04c6e98cb5e609f9be472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:30.060194 2105 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:30.060964 1405 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 2 FOLLOWER]: Refusing update from remote peer f1e6af049ae04c6e98cb5e609f9be472: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260429 08:00:30.061882 2182 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f1e6af049ae04c6e98cb5e609f9be472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:30.061971 2182 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:30.062409 2105 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260429 08:00:30.069680 2213 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1e6af049ae04c6e98cb5e609f9be472. Latest consensus state: current_term: 2 leader_uuid: "f1e6af049ae04c6e98cb5e609f9be472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:30.069801 2213 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:30.069871 2213 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f1e6af049ae04c6e98cb5e609f9be472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:30.069922 2213 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:30.135746 1466 catalog_manager.cc:2174] created HMS catalog entry for table [id=22977f026381472a97eeaf0d3112fa07]
I20260429 08:00:30.138147 2206 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f1e6af049ae04c6e98cb5e609f9be472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:30.138280 2206 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:30.151178 1466 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58408:
table { table_name: "default.Table_9b98ec36c0514c4e9e1e5d745435032f" } new_table_name: "default.Table_00c8e8b0543b48458c08b780734269c6" modify_external_catalogs: true
I20260429 08:00:30.180193 1849 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf7123a6ef7448c96eb22787fc7dfcc (DEFAULT_TABLE table=default.table_9b98ec36c0514c4e9e1e5d745435032f [id=22977f026381472a97eeaf0d3112fa07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.181267 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf7123a6ef7448c96eb22787fc7dfcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.181591 1985 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf7123a6ef7448c96eb22787fc7dfcc (DEFAULT_TABLE table=default.table_9b98ec36c0514c4e9e1e5d745435032f [id=22977f026381472a97eeaf0d3112fa07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.182497 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf7123a6ef7448c96eb22787fc7dfcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.184551 1711 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf7123a6ef7448c96eb22787fc7dfcc (DEFAULT_TABLE table=default.table_9b98ec36c0514c4e9e1e5d745435032f [id=22977f026381472a97eeaf0d3112fa07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.185379 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf7123a6ef7448c96eb22787fc7dfcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.188226 2224 tablet_bootstrap.cc:492] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.190694 2225 tablet_bootstrap.cc:492] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.191040 2224 tablet_bootstrap.cc:654] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.191661 1463 catalog_manager.cc:2174] created HMS catalog entry for table [id=8ec0fa88b9c645e1aa026d8e57ee5a08]
I20260429 08:00:30.191814 2224 log.cc:826] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:30.192642 2225 tablet_bootstrap.cc:654] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.193401 2225 log.cc:826] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:30.194075 2223 tablet_bootstrap.cc:492] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.197889 2223 tablet_bootstrap.cc:654] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.198689 2223 log.cc:826] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:30.200352 2225 tablet_bootstrap.cc:492] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.200590 2225 ts_tablet_manager.cc:1403] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
I20260429 08:00:30.202016 2224 tablet_bootstrap.cc:492] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.202275 2224 ts_tablet_manager.cc:1403] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260429 08:00:30.203215 1463 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58408:
table { table_name: "default.Table_ac03de9e4e6343c89e902b1c64baee24" } new_table_name: "default.Table_03bb29fc9f854e85b7fc52f6523c6db0" modify_external_catalogs: true
I20260429 08:00:30.204244 2225 raft_consensus.cc:359] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.204450 2225 raft_consensus.cc:385] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.204509 2225 raft_consensus.cc:740] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.205479 2225 consensus_queue.cc:260] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.206563 2225 ts_tablet_manager.cc:1434] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.006s user 0.004s sys 0.001s
I20260429 08:00:30.206974 1849 tablet_service.cc:1511] Processing CreateTablet for tablet 3493ce73d32a4c9fbae60ae2901142d4 (DEFAULT_TABLE table=default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.207291 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3493ce73d32a4c9fbae60ae2901142d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.207875 2224 raft_consensus.cc:359] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.208176 2224 raft_consensus.cc:385] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.208276 2224 raft_consensus.cc:740] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.208734 2224 consensus_queue.cc:260] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.209684 2224 ts_tablet_manager.cc:1434] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260429 08:00:30.210012 1711 tablet_service.cc:1511] Processing CreateTablet for tablet 3493ce73d32a4c9fbae60ae2901142d4 (DEFAULT_TABLE table=default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.210290 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3493ce73d32a4c9fbae60ae2901142d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.213447 1779 heartbeater.cc:499] Master 127.1.14.61:33847 was elected leader, sending a full tablet report...
I20260429 08:00:30.215729 1985 tablet_service.cc:1511] Processing CreateTablet for tablet 3493ce73d32a4c9fbae60ae2901142d4 (DEFAULT_TABLE table=default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.216100 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3493ce73d32a4c9fbae60ae2901142d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.218780 2224 tablet_bootstrap.cc:492] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.219834 2224 tablet_bootstrap.cc:654] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.219949 1777 heartbeater.cc:344] Connected to a master server at 127.1.14.60:41737
I20260429 08:00:30.220057 1777 heartbeater.cc:499] Master 127.1.14.60:41737 was elected leader, sending a full tablet report...
I20260429 08:00:30.220610 2223 tablet_bootstrap.cc:492] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.220820 2223 ts_tablet_manager.cc:1403] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.000s
I20260429 08:00:30.220813 2142 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6441a846e67a46159cef1413b6d06337" instance_seqno: 1777449628680786) as {username='slave'} at 127.1.14.1:42419; Asking this server to re-register.
I20260429 08:00:30.221271 2224 tablet_bootstrap.cc:492] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.221310 1777 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:30.221349 2224 ts_tablet_manager.cc:1403] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260429 08:00:30.221830 2224 raft_consensus.cc:359] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.221946 2224 raft_consensus.cc:385] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.221976 2224 raft_consensus.cc:740] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.222093 2224 consensus_queue.cc:260] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.222296 2142 ts_manager.cc:194] Registered new tserver with Master: 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:30.222350 2224 ts_tablet_manager.cc:1434] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.226620 2223 raft_consensus.cc:359] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.226871 2223 raft_consensus.cc:385] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.226940 2223 raft_consensus.cc:740] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.227448 2223 consensus_queue.cc:260] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.228428 2223 ts_tablet_manager.cc:1434] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260429 08:00:30.225448 2225 tablet_bootstrap.cc:492] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.229678 2225 tablet_bootstrap.cc:654] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.230062 1917 heartbeater.cc:499] Master 127.1.14.61:33847 was elected leader, sending a full tablet report...
I20260429 08:00:30.231330 2225 tablet_bootstrap.cc:492] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.231413 2225 ts_tablet_manager.cc:1403] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260429 08:00:30.231941 2225 raft_consensus.cc:359] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.232055 2225 raft_consensus.cc:385] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.232087 2225 raft_consensus.cc:740] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.232224 2225 consensus_queue.cc:260] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.232512 2225 ts_tablet_manager.cc:1434] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.232940 2223 tablet_bootstrap.cc:492] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.234463 2223 tablet_bootstrap.cc:654] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.235821 2223 tablet_bootstrap.cc:492] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.235921 2223 ts_tablet_manager.cc:1403] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260429 08:00:30.236481 2223 raft_consensus.cc:359] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.236616 2223 raft_consensus.cc:385] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.236660 2223 raft_consensus.cc:740] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.236828 2223 consensus_queue.cc:260] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.237123 2223 ts_tablet_manager.cc:1434] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.246259 2232 raft_consensus.cc:493] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.246387 2232 raft_consensus.cc:515] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.247392 2232 leader_election.cc:290] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.248000 1461 catalog_manager.cc:2174] created HMS catalog entry for table [id=a7b78c42cfef44fcafe72b4f588505c2]
I20260429 08:00:30.251544 1731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3493ce73d32a4c9fbae60ae2901142d4" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:30.251827 1731 raft_consensus.cc:2468] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:30.252287 1803 leader_election.cc:304] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:30.253679 2232 raft_consensus.cc:2804] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.253755 2232 raft_consensus.cc:493] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.253799 2232 raft_consensus.cc:3060] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.254824 2232 raft_consensus.cc:515] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.255163 2232 leader_election.cc:290] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.255437 1731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3493ce73d32a4c9fbae60ae2901142d4" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:30.255543 1731 raft_consensus.cc:3060] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.256649 1731 raft_consensus.cc:2468] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:30.256971 1803 leader_election.cc:304] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:30.258270 1711 tablet_service.cc:1511] Processing CreateTablet for tablet 2efca20a4b054a0aa1a486017a2f35fa (DEFAULT_TABLE table=default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.258327 1849 tablet_service.cc:1511] Processing CreateTablet for tablet 2efca20a4b054a0aa1a486017a2f35fa (DEFAULT_TABLE table=default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.258525 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efca20a4b054a0aa1a486017a2f35fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.258525 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efca20a4b054a0aa1a486017a2f35fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.258893 1985 tablet_service.cc:1511] Processing CreateTablet for tablet 2efca20a4b054a0aa1a486017a2f35fa (DEFAULT_TABLE table=default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.259168 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efca20a4b054a0aa1a486017a2f35fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.260432 2225 tablet_bootstrap.cc:492] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.261129 2224 tablet_bootstrap.cc:492] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.261441 2225 tablet_bootstrap.cc:654] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.261951 2224 tablet_bootstrap.cc:654] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.262779 2225 tablet_bootstrap.cc:492] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.262879 2225 ts_tablet_manager.cc:1403] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:30.263361 2232 raft_consensus.cc:2804] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.263561 2232 raft_consensus.cc:697] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:30.263515 2225 raft_consensus.cc:359] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.263620 2225 raft_consensus.cc:385] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.263656 2225 raft_consensus.cc:740] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.263713 2224 tablet_bootstrap.cc:492] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.263799 2224 ts_tablet_manager.cc:1403] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260429 08:00:30.263868 2232 consensus_queue.cc:237] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.264272 2225 consensus_queue.cc:260] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.264283 2224 raft_consensus.cc:359] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.264402 2224 raft_consensus.cc:385] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.264442 2224 raft_consensus.cc:740] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.264607 2224 consensus_queue.cc:260] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.264873 2224 ts_tablet_manager.cc:1434] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.269455 1461 catalog_manager.cc:5671] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 353e59f343974ee68738535fb9029d30 (127.1.14.2). New cstate: current_term: 1 leader_uuid: "353e59f343974ee68738535fb9029d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:30.270503 2225 ts_tablet_manager.cc:1434] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260429 08:00:30.274264 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3493ce73d32a4c9fbae60ae2901142d4" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:30.274497 2005 raft_consensus.cc:2468] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:30.274757 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3493ce73d32a4c9fbae60ae2901142d4" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:30.274869 2004 raft_consensus.cc:3060] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.276008 2004 raft_consensus.cc:2468] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:30.277889 1461 master_service.cc:954] ReplaceTablet: received request to replace tablet 3493ce73d32a4c9fbae60ae2901142d4 from {username='slave'} at 127.0.0.1:58408
W20260429 08:00:30.279579 2054 tablet.cc:2404] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260429 08:00:30.281313 2223 tablet_bootstrap.cc:492] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.281874 1461 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Sending DeleteTablet for 3 replicas of tablet 3493ce73d32a4c9fbae60ae2901142d4
I20260429 08:00:30.282435 2223 tablet_bootstrap.cc:654] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.283130 1461 catalog_manager.cc:6741] ReplaceTablet: tablet 3493ce73d32a4c9fbae60ae2901142d4 deleted and replaced by tablet e5f89d4dc7e44c2cbdeb939127f13c6e
I20260429 08:00:30.283334 1461 master_service.cc:954] ReplaceTablet: received request to replace tablet 3493ce73d32a4c9fbae60ae2901142d4 from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:30.283324 1985 tablet_service.cc:1558] Processing DeleteTablet for tablet 3493ce73d32a4c9fbae60ae2901142d4 with delete_type TABLET_DATA_DELETED (replaced by tablet e5f89d4dc7e44c2cbdeb939127f13c6e) from {username='slave'} at 127.0.0.1:45446
I20260429 08:00:30.283668 1461 master_service.cc:954] ReplaceTablet: received request to replace tablet 9bf7123a6ef7448c96eb22787fc7dfcc from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:30.284919 1849 tablet_service.cc:1558] Processing DeleteTablet for tablet 3493ce73d32a4c9fbae60ae2901142d4 with delete_type TABLET_DATA_DELETED (replaced by tablet e5f89d4dc7e44c2cbdeb939127f13c6e) from {username='slave'} at 127.0.0.1:49014
I20260429 08:00:30.285364 2242 tablet_replica.cc:333] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:30.285727 1711 tablet_service.cc:1558] Processing DeleteTablet for tablet 3493ce73d32a4c9fbae60ae2901142d4 with delete_type TABLET_DATA_DELETED (replaced by tablet e5f89d4dc7e44c2cbdeb939127f13c6e) from {username='slave'} at 127.0.0.1:45318
I20260429 08:00:30.286218 2241 tablet_replica.cc:333] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:30.286485 2241 raft_consensus.cc:2243] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:30.286756 2241 raft_consensus.cc:2272] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.288404 2223 tablet_bootstrap.cc:492] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.288502 2223 ts_tablet_manager.cc:1403] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20260429 08:00:30.288808 1849 tablet_service.cc:1511] Processing CreateTablet for tablet e5f89d4dc7e44c2cbdeb939127f13c6e (DEFAULT_TABLE table=default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.289050 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f89d4dc7e44c2cbdeb939127f13c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.289029 2223 raft_consensus.cc:359] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.289070 1711 tablet_service.cc:1511] Processing CreateTablet for tablet e5f89d4dc7e44c2cbdeb939127f13c6e (DEFAULT_TABLE table=default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.289140 2223 raft_consensus.cc:385] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.289187 2223 raft_consensus.cc:740] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.289288 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f89d4dc7e44c2cbdeb939127f13c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.289328 2223 consensus_queue.cc:260] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.291038 2223 ts_tablet_manager.cc:1434] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:30.291429 2225 tablet_bootstrap.cc:492] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.291474 1985 tablet_service.cc:1511] Processing CreateTablet for tablet e5f89d4dc7e44c2cbdeb939127f13c6e (DEFAULT_TABLE table=default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.291739 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f89d4dc7e44c2cbdeb939127f13c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.292488 2225 tablet_bootstrap.cc:654] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.293785 2224 tablet_bootstrap.cc:492] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.294643 2224 tablet_bootstrap.cc:654] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.294788 1461 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Sending DeleteTablet for 3 replicas of tablet 9bf7123a6ef7448c96eb22787fc7dfcc
I20260429 08:00:30.295073 1461 catalog_manager.cc:6741] ReplaceTablet: tablet 9bf7123a6ef7448c96eb22787fc7dfcc deleted and replaced by tablet 14d1f856aca94369a644ecd753f61af0
I20260429 08:00:30.295759 1461 master_service.cc:954] ReplaceTablet: received request to replace tablet 9bf7123a6ef7448c96eb22787fc7dfcc from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:30.296038 1461 master_service.cc:954] ReplaceTablet: received request to replace tablet 3493ce73d32a4c9fbae60ae2901142d4 from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:30.296231 2223 tablet_bootstrap.cc:492] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.296311 1461 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58408:
table { table_name: "default.Table_5d064684efbd44ca80193c9417a8308f" } new_table_name: "default.Table_99b9b733ad5c4a149389412905245938" modify_external_catalogs: true
I20260429 08:00:30.297777 2223 tablet_bootstrap.cc:654] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.298856 2224 tablet_bootstrap.cc:492] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.298955 2224 ts_tablet_manager.cc:1403] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260429 08:00:30.298990 1711 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bf7123a6ef7448c96eb22787fc7dfcc with delete_type TABLET_DATA_DELETED (replaced by tablet 14d1f856aca94369a644ecd753f61af0) from {username='slave'} at 127.0.0.1:45318
I20260429 08:00:30.299156 1849 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bf7123a6ef7448c96eb22787fc7dfcc with delete_type TABLET_DATA_DELETED (replaced by tablet 14d1f856aca94369a644ecd753f61af0) from {username='slave'} at 127.0.0.1:49014
I20260429 08:00:30.299420 2224 raft_consensus.cc:359] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.299523 2224 raft_consensus.cc:385] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.299559 2224 raft_consensus.cc:740] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.299685 2224 consensus_queue.cc:260] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.299942 2224 ts_tablet_manager.cc:1434] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.300074 2241 ts_tablet_manager.cc:1916] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.300921 1985 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bf7123a6ef7448c96eb22787fc7dfcc with delete_type TABLET_DATA_DELETED (replaced by tablet 14d1f856aca94369a644ecd753f61af0) from {username='slave'} at 127.0.0.1:45446
I20260429 08:00:30.302343 2241 ts_tablet_manager.cc:1929] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260429 08:00:30.302431 2241 log.cc:1199] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/3493ce73d32a4c9fbae60ae2901142d4
I20260429 08:00:30.302734 2241 ts_tablet_manager.cc:1950] T 3493ce73d32a4c9fbae60ae2901142d4 P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:30.303350 1711 tablet_service.cc:1511] Processing CreateTablet for tablet 14d1f856aca94369a644ecd753f61af0 (DEFAULT_TABLE table=default.table_9b98ec36c0514c4e9e1e5d745435032f [id=22977f026381472a97eeaf0d3112fa07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.303390 1985 tablet_service.cc:1511] Processing CreateTablet for tablet 14d1f856aca94369a644ecd753f61af0 (DEFAULT_TABLE table=default.table_9b98ec36c0514c4e9e1e5d745435032f [id=22977f026381472a97eeaf0d3112fa07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.303593 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d1f856aca94369a644ecd753f61af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.303609 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d1f856aca94369a644ecd753f61af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.303821 2241 tablet_replica.cc:333] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:30.303928 2241 raft_consensus.cc:2243] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:30.304026 2241 raft_consensus.cc:2272] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.304641 2225 tablet_bootstrap.cc:492] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.304729 2225 ts_tablet_manager.cc:1403] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260429 08:00:30.305061 1849 tablet_service.cc:1511] Processing CreateTablet for tablet 14d1f856aca94369a644ecd753f61af0 (DEFAULT_TABLE table=default.table_9b98ec36c0514c4e9e1e5d745435032f [id=22977f026381472a97eeaf0d3112fa07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.305182 2225 raft_consensus.cc:359] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.305296 2225 raft_consensus.cc:385] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.305330 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d1f856aca94369a644ecd753f61af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.305347 2225 raft_consensus.cc:740] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.305469 2225 consensus_queue.cc:260] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.305691 1453 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet 3493ce73d32a4c9fbae60ae2901142d4 (table default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]) successfully deleted
I20260429 08:00:30.305740 2225 ts_tablet_manager.cc:1434] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.305985 2225 tablet_bootstrap.cc:492] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.306986 2225 tablet_bootstrap.cc:654] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.309526 2224 tablet_bootstrap.cc:492] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.287057 2242 raft_consensus.cc:2243] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:30.310182 2242 pending_rounds.cc:70] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30: Trying to abort 1 pending ops.
I20260429 08:00:30.310294 2242 pending_rounds.cc:77] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7280433685563928576 op_type: NO_OP noop_request { }
I20260429 08:00:30.310397 2242 raft_consensus.cc:2889] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260429 08:00:30.310478 2242 raft_consensus.cc:2272] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.310503 2224 tablet_bootstrap.cc:654] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.311205 2241 ts_tablet_manager.cc:1916] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.311595 2223 tablet_bootstrap.cc:492] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.311678 2223 ts_tablet_manager.cc:1403] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.002s
I20260429 08:00:30.311873 2242 ts_tablet_manager.cc:1916] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.312301 2223 raft_consensus.cc:359] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.312408 2223 raft_consensus.cc:385] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.312451 2223 raft_consensus.cc:740] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.312626 2223 consensus_queue.cc:260] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.313114 2241 ts_tablet_manager.cc:1929] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260429 08:00:30.313176 2241 log.cc:1199] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/9bf7123a6ef7448c96eb22787fc7dfcc
I20260429 08:00:30.313364 2241 ts_tablet_manager.cc:1950] T 9bf7123a6ef7448c96eb22787fc7dfcc P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:30.314083 2242 ts_tablet_manager.cc:1929] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:30.314165 2242 log.cc:1199] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/3493ce73d32a4c9fbae60ae2901142d4
I20260429 08:00:30.314342 2223 ts_tablet_manager.cc:1434] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260429 08:00:30.314440 2242 ts_tablet_manager.cc:1950] T 3493ce73d32a4c9fbae60ae2901142d4 P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:30.314918 1453 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet 9bf7123a6ef7448c96eb22787fc7dfcc (table default.table_9b98ec36c0514c4e9e1e5d745435032f [id=22977f026381472a97eeaf0d3112fa07]) successfully deleted
I20260429 08:00:30.315342 2242 tablet_replica.cc:333] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:30.315411 2242 raft_consensus.cc:2243] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:30.315466 2242 raft_consensus.cc:2272] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.315507 1452 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet 3493ce73d32a4c9fbae60ae2901142d4 (table default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]) successfully deleted
I20260429 08:00:30.315697 2243 tablet_replica.cc:333] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:30.315874 2223 tablet_bootstrap.cc:492] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.315960 2243 raft_consensus.cc:2243] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:30.316215 2243 raft_consensus.cc:2272] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.317124 2225 tablet_bootstrap.cc:492] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.317198 2225 ts_tablet_manager.cc:1403] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260429 08:00:30.317252 2243 ts_tablet_manager.cc:1916] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.317611 2225 raft_consensus.cc:359] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.317694 2225 raft_consensus.cc:385] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.317719 2225 raft_consensus.cc:740] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.317823 2225 consensus_queue.cc:260] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.318097 2225 ts_tablet_manager.cc:1434] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.319301 2243 ts_tablet_manager.cc:1929] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260429 08:00:30.319375 2243 log.cc:1199] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/3493ce73d32a4c9fbae60ae2901142d4
I20260429 08:00:30.319620 2243 ts_tablet_manager.cc:1950] T 3493ce73d32a4c9fbae60ae2901142d4 P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:30.320633 2243 tablet_replica.cc:333] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:30.320734 2243 raft_consensus.cc:2243] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:30.320704 1451 catalog_manager.cc:5002] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): tablet 3493ce73d32a4c9fbae60ae2901142d4 (table default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]) successfully deleted
I20260429 08:00:30.320807 2243 raft_consensus.cc:2272] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.320973 2223 tablet_bootstrap.cc:654] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.321157 2242 ts_tablet_manager.cc:1916] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.322079 2223 tablet_bootstrap.cc:492] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.322152 2223 ts_tablet_manager.cc:1403] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260429 08:00:30.322576 2223 raft_consensus.cc:359] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.322669 2242 ts_tablet_manager.cc:1929] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260429 08:00:30.322669 2223 raft_consensus.cc:385] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.322777 2242 log.cc:1199] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/9bf7123a6ef7448c96eb22787fc7dfcc
I20260429 08:00:30.322788 2223 raft_consensus.cc:740] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.322925 2223 consensus_queue.cc:260] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.323000 2242 ts_tablet_manager.cc:1950] T 9bf7123a6ef7448c96eb22787fc7dfcc P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:30.323073 2224 tablet_bootstrap.cc:492] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.323158 2224 ts_tablet_manager.cc:1403] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260429 08:00:30.323225 2223 ts_tablet_manager.cc:1434] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.323755 2224 raft_consensus.cc:359] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.323853 2224 raft_consensus.cc:385] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.323894 2224 raft_consensus.cc:740] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.323959 2243 ts_tablet_manager.cc:1916] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.324005 2224 consensus_queue.cc:260] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.324266 2224 ts_tablet_manager.cc:1434] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.324831 1452 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet 9bf7123a6ef7448c96eb22787fc7dfcc (table default.table_9b98ec36c0514c4e9e1e5d745435032f [id=22977f026381472a97eeaf0d3112fa07]) successfully deleted
I20260429 08:00:30.325785 2243 ts_tablet_manager.cc:1929] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260429 08:00:30.325868 2243 log.cc:1199] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/9bf7123a6ef7448c96eb22787fc7dfcc
I20260429 08:00:30.326073 2243 ts_tablet_manager.cc:1950] T 9bf7123a6ef7448c96eb22787fc7dfcc P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:30.326650 1451 catalog_manager.cc:5002] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): tablet 9bf7123a6ef7448c96eb22787fc7dfcc (table default.table_9b98ec36c0514c4e9e1e5d745435032f [id=22977f026381472a97eeaf0d3112fa07]) successfully deleted
I20260429 08:00:30.340127 1465 catalog_manager.cc:2174] created HMS catalog entry for table [id=7642795dd6414b8eaf42383b571d3f91]
W20260429 08:00:30.357007 1918 tablet.cc:2404] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260429 08:00:30.359223 1849 tablet_service.cc:1511] Processing CreateTablet for tablet 6bed1294b08649efa2f6521e9cefe6b6 (DEFAULT_TABLE table=default.table_5bbc20bf027b4b4eb99c583f351cf1b1 [id=7642795dd6414b8eaf42383b571d3f91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.359546 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bed1294b08649efa2f6521e9cefe6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.359562 1465 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_ba60f2d687a9431288851fb68b310758"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:30.360234 1985 tablet_service.cc:1511] Processing CreateTablet for tablet 6bed1294b08649efa2f6521e9cefe6b6 (DEFAULT_TABLE table=default.table_5bbc20bf027b4b4eb99c583f351cf1b1 [id=7642795dd6414b8eaf42383b571d3f91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.360481 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bed1294b08649efa2f6521e9cefe6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.361763 2223 tablet_bootstrap.cc:492] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.362520 2224 tablet_bootstrap.cc:492] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.362802 2223 tablet_bootstrap.cc:654] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.364161 2224 tablet_bootstrap.cc:654] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.365720 1711 tablet_service.cc:1511] Processing CreateTablet for tablet 6bed1294b08649efa2f6521e9cefe6b6 (DEFAULT_TABLE table=default.table_5bbc20bf027b4b4eb99c583f351cf1b1 [id=7642795dd6414b8eaf42383b571d3f91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.366051 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bed1294b08649efa2f6521e9cefe6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.368342 2225 tablet_bootstrap.cc:492] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.369688 2225 tablet_bootstrap.cc:654] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.374282 2223 tablet_bootstrap.cc:492] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.374382 2223 ts_tablet_manager.cc:1403] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260429 08:00:30.374866 2223 raft_consensus.cc:359] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.374974 2223 raft_consensus.cc:385] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.375022 2223 raft_consensus.cc:740] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.375146 2223 consensus_queue.cc:260] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.375402 2223 ts_tablet_manager.cc:1434] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.377508 2225 tablet_bootstrap.cc:492] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.377597 2225 ts_tablet_manager.cc:1403] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260429 08:00:30.378008 2225 raft_consensus.cc:359] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.378125 2225 raft_consensus.cc:385] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.378159 2225 raft_consensus.cc:740] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.378291 2225 consensus_queue.cc:260] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.378400 2224 tablet_bootstrap.cc:492] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.378495 2224 ts_tablet_manager.cc:1403] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.001s
I20260429 08:00:30.378561 2225 ts_tablet_manager.cc:1434] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.378978 2224 raft_consensus.cc:359] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.379761 2224 raft_consensus.cc:385] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.379808 2224 raft_consensus.cc:740] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.379962 2224 consensus_queue.cc:260] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.380244 2224 ts_tablet_manager.cc:1434] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260429 08:00:30.386253 1460 catalog_manager.cc:2174] created HMS catalog entry for table [id=a4ed989a19884204881820516d9704c3]
I20260429 08:00:30.390893 2230 raft_consensus.cc:493] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.391002 2230 raft_consensus.cc:515] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.392256 2230 leader_election.cc:290] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:30.393263 1460 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58408:
table { table_name: "default.Table_5bbc20bf027b4b4eb99c583f351cf1b1" } new_table_name: "default.Table_a3cf45aaf37c4ddf9ed00173d7c72a4c" modify_external_catalogs: true
I20260429 08:00:30.398663 1869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f89d4dc7e44c2cbdeb939127f13c6e" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:30.398885 1869 raft_consensus.cc:2468] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:30.399468 1939 leader_election.cc:304] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.400400 2230 raft_consensus.cc:2804] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.400460 2230 raft_consensus.cc:493] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.400491 2230 raft_consensus.cc:3060] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.401611 2230 raft_consensus.cc:515] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.401997 2230 leader_election.cc:290] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:30.402550 1731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f89d4dc7e44c2cbdeb939127f13c6e" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:30.402675 1731 raft_consensus.cc:2468] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:30.402911 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f89d4dc7e44c2cbdeb939127f13c6e" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:30.403012 1730 raft_consensus.cc:3060] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.403964 1730 raft_consensus.cc:2468] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:30.404284 1938 leader_election.cc:304] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.404968 1869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f89d4dc7e44c2cbdeb939127f13c6e" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:30.405090 1869 raft_consensus.cc:3060] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.406616 1869 raft_consensus.cc:2468] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:30.406623 2230 raft_consensus.cc:2804] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.406855 2230 raft_consensus.cc:697] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [term 1 LEADER]: Becoming Leader. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Running, Role: LEADER
I20260429 08:00:30.407135 2230 consensus_queue.cc:237] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.407375 1849 tablet_service.cc:1511] Processing CreateTablet for tablet 881e1249f58b4480ad5940e69ee49788 (DEFAULT_TABLE table=default.table_5ce59414814f4106ae9ad5a804275bb7 [id=a4ed989a19884204881820516d9704c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.407473 1711 tablet_service.cc:1511] Processing CreateTablet for tablet 881e1249f58b4480ad5940e69ee49788 (DEFAULT_TABLE table=default.table_5ce59414814f4106ae9ad5a804275bb7 [id=a4ed989a19884204881820516d9704c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.407634 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881e1249f58b4480ad5940e69ee49788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.407662 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881e1249f58b4480ad5940e69ee49788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.408908 1985 tablet_service.cc:1511] Processing CreateTablet for tablet 881e1249f58b4480ad5940e69ee49788 (DEFAULT_TABLE table=default.table_5ce59414814f4106ae9ad5a804275bb7 [id=a4ed989a19884204881820516d9704c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.409133 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881e1249f58b4480ad5940e69ee49788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.409524 2225 tablet_bootstrap.cc:492] T 881e1249f58b4480ad5940e69ee49788 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.410538 2225 tablet_bootstrap.cc:654] T 881e1249f58b4480ad5940e69ee49788 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.411408 2224 tablet_bootstrap.cc:492] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.412382 2224 tablet_bootstrap.cc:654] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.414166 2223 tablet_bootstrap.cc:492] T 881e1249f58b4480ad5940e69ee49788 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.415217 2223 tablet_bootstrap.cc:654] T 881e1249f58b4480ad5940e69ee49788 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.418629 2225 tablet_bootstrap.cc:492] T 881e1249f58b4480ad5940e69ee49788 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.418761 2225 ts_tablet_manager.cc:1403] T 881e1249f58b4480ad5940e69ee49788 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260429 08:00:30.419224 2225 raft_consensus.cc:359] T 881e1249f58b4480ad5940e69ee49788 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.419348 2225 raft_consensus.cc:385] T 881e1249f58b4480ad5940e69ee49788 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.419397 2225 raft_consensus.cc:740] T 881e1249f58b4480ad5940e69ee49788 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.419549 2225 consensus_queue.cc:260] T 881e1249f58b4480ad5940e69ee49788 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.419804 2225 ts_tablet_manager.cc:1434] T 881e1249f58b4480ad5940e69ee49788 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.421489 2223 tablet_bootstrap.cc:492] T 881e1249f58b4480ad5940e69ee49788 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.421586 2223 ts_tablet_manager.cc:1403] T 881e1249f58b4480ad5940e69ee49788 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260429 08:00:30.422098 2223 raft_consensus.cc:359] T 881e1249f58b4480ad5940e69ee49788 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.422202 2223 raft_consensus.cc:385] T 881e1249f58b4480ad5940e69ee49788 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.422236 2223 raft_consensus.cc:740] T 881e1249f58b4480ad5940e69ee49788 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.422370 2223 consensus_queue.cc:260] T 881e1249f58b4480ad5940e69ee49788 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.422655 2223 ts_tablet_manager.cc:1434] T 881e1249f58b4480ad5940e69ee49788 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.427682 2229 raft_consensus.cc:493] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.427778 2229 raft_consensus.cc:515] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.429029 2229 leader_election.cc:290] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.433522 2224 tablet_bootstrap.cc:492] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.433621 2224 ts_tablet_manager.cc:1403] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.002s
I20260429 08:00:30.434128 2224 raft_consensus.cc:359] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.434232 2224 raft_consensus.cc:385] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.434262 2224 raft_consensus.cc:740] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.434372 2224 consensus_queue.cc:260] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.434644 2224 ts_tablet_manager.cc:1434] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260429 08:00:30.435698 1869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efca20a4b054a0aa1a486017a2f35fa" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:30.435817 1869 raft_consensus.cc:2468] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:30.436496 1666 leader_election.cc:304] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
W20260429 08:00:30.436661 1780 tablet.cc:2404] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260429 08:00:30.438247 2229 raft_consensus.cc:2804] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.438309 2229 raft_consensus.cc:493] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.438347 2229 raft_consensus.cc:3060] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.439324 2229 raft_consensus.cc:515] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.439663 2229 leader_election.cc:290] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Requested vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.440234 1869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efca20a4b054a0aa1a486017a2f35fa" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:30.440337 1869 raft_consensus.cc:3060] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.441278 1869 raft_consensus.cc:2468] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:30.441766 1666 leader_election.cc:304] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:30.442261 2229 raft_consensus.cc:2804] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.442596 2229 raft_consensus.cc:697] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Becoming Leader. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Running, Role: LEADER
I20260429 08:00:30.442855 2229 consensus_queue.cc:237] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.445391 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efca20a4b054a0aa1a486017a2f35fa" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:30.445456 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efca20a4b054a0aa1a486017a2f35fa" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:30.445535 2004 raft_consensus.cc:2468] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:30.448128 1457 catalog_manager.cc:2174] created HMS catalog entry for table [id=f9917ae2527843028b7d5d42c72bb753]
I20260429 08:00:30.453125 1457 catalog_manager.cc:5671] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a reported cstate change: term changed from 0 to 1, leader changed from <none> to 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3). New cstate: current_term: 1 leader_uuid: "873f2b4fab6f42738b2d41b4608a592a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: HEALTHY } } }
I20260429 08:00:30.464665 1849 tablet_service.cc:1511] Processing CreateTablet for tablet 5561e3ecf0a1411d863de987110ce64f (DEFAULT_TABLE table=default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.465011 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5561e3ecf0a1411d863de987110ce64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.465263 1985 tablet_service.cc:1511] Processing CreateTablet for tablet 5561e3ecf0a1411d863de987110ce64f (DEFAULT_TABLE table=default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.465557 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5561e3ecf0a1411d863de987110ce64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.467155 2223 tablet_bootstrap.cc:492] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.467960 2224 tablet_bootstrap.cc:492] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.468026 1711 tablet_service.cc:1511] Processing CreateTablet for tablet 5561e3ecf0a1411d863de987110ce64f (DEFAULT_TABLE table=default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.468207 2223 tablet_bootstrap.cc:654] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.468287 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5561e3ecf0a1411d863de987110ce64f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.469211 2224 tablet_bootstrap.cc:654] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.470530 2225 tablet_bootstrap.cc:492] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.470885 1457 catalog_manager.cc:5671] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6441a846e67a46159cef1413b6d06337 (127.1.14.1). New cstate: current_term: 1 leader_uuid: "6441a846e67a46159cef1413b6d06337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:30.471728 2225 tablet_bootstrap.cc:654] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.473918 2225 tablet_bootstrap.cc:492] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.474022 2225 ts_tablet_manager.cc:1403] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260429 08:00:30.474519 2225 raft_consensus.cc:359] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.474647 2225 raft_consensus.cc:385] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.474680 2225 raft_consensus.cc:740] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.475159 2225 consensus_queue.cc:260] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.477252 2224 tablet_bootstrap.cc:492] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.477358 2224 ts_tablet_manager.cc:1403] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260429 08:00:30.477852 2224 raft_consensus.cc:359] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.477969 2224 raft_consensus.cc:385] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.477999 2224 raft_consensus.cc:740] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.478129 2224 consensus_queue.cc:260] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.478420 2224 ts_tablet_manager.cc:1434] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.481396 1457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58408:
table { table_name: "default.Table_5ce59414814f4106ae9ad5a804275bb7" } new_table_name: "default.Table_6795420cac01458198a3bf0876fd6092" modify_external_catalogs: true
I20260429 08:00:30.481953 2225 ts_tablet_manager.cc:1434] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260429 08:00:30.485477 2223 tablet_bootstrap.cc:492] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.485587 2223 ts_tablet_manager.cc:1403] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.002s
I20260429 08:00:30.486173 2223 raft_consensus.cc:359] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.486289 2223 raft_consensus.cc:385] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.486325 2223 raft_consensus.cc:740] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.486637 2223 consensus_queue.cc:260] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.489188 2223 ts_tablet_manager.cc:1434] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260429 08:00:30.507251 1462 catalog_manager.cc:2174] created HMS catalog entry for table [id=e109005a4ef9476f8a0fc5021a89f7fb]
I20260429 08:00:30.514827 1462 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_207de250815e4c1793355de8d028abec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:30.523819 1985 tablet_service.cc:1511] Processing CreateTablet for tablet cd90dd0711a448a18540c23f505ee522 (DEFAULT_TABLE table=default.table_a5c75ef558e9422c9e29eaa5ad3e92ae [id=e109005a4ef9476f8a0fc5021a89f7fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.524173 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd90dd0711a448a18540c23f505ee522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.526566 1849 tablet_service.cc:1511] Processing CreateTablet for tablet cd90dd0711a448a18540c23f505ee522 (DEFAULT_TABLE table=default.table_a5c75ef558e9422c9e29eaa5ad3e92ae [id=e109005a4ef9476f8a0fc5021a89f7fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.526916 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd90dd0711a448a18540c23f505ee522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.528743 2224 tablet_bootstrap.cc:492] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.529814 2224 tablet_bootstrap.cc:654] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.531075 1711 tablet_service.cc:1511] Processing CreateTablet for tablet cd90dd0711a448a18540c23f505ee522 (DEFAULT_TABLE table=default.table_a5c75ef558e9422c9e29eaa5ad3e92ae [id=e109005a4ef9476f8a0fc5021a89f7fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.531379 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd90dd0711a448a18540c23f505ee522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.533375 2225 tablet_bootstrap.cc:492] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.534301 2225 tablet_bootstrap.cc:654] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.536345 2223 tablet_bootstrap.cc:492] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.537308 2223 tablet_bootstrap.cc:654] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.539055 2225 tablet_bootstrap.cc:492] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.539143 2225 ts_tablet_manager.cc:1403] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260429 08:00:30.539661 2225 raft_consensus.cc:359] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.539769 2225 raft_consensus.cc:385] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.539848 2225 raft_consensus.cc:740] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.539968 2225 consensus_queue.cc:260] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.540210 2225 ts_tablet_manager.cc:1434] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.541697 2232 raft_consensus.cc:493] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.541797 2232 raft_consensus.cc:515] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.542187 2232 leader_election.cc:290] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.542950 2224 tablet_bootstrap.cc:492] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.543044 2224 ts_tablet_manager.cc:1403] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20260429 08:00:30.543099 1459 catalog_manager.cc:2174] created HMS catalog entry for table [id=378948ee2c1540f68e35f3249e863a7e]
I20260429 08:00:30.543129 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5561e3ecf0a1411d863de987110ce64f" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:30.543241 2005 raft_consensus.cc:2468] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:30.543526 2224 raft_consensus.cc:359] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.543630 2224 raft_consensus.cc:385] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.543663 2224 raft_consensus.cc:740] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.543695 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5561e3ecf0a1411d863de987110ce64f" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:30.543789 1730 raft_consensus.cc:2468] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:30.543785 2224 consensus_queue.cc:260] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.544097 2224 ts_tablet_manager.cc:1434] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.544186 1805 leader_election.cc:304] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.544812 2223 tablet_bootstrap.cc:492] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.544910 2223 ts_tablet_manager.cc:1403] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260429 08:00:30.545308 2223 raft_consensus.cc:359] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.545411 2223 raft_consensus.cc:385] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.545446 2223 raft_consensus.cc:740] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.545562 2223 consensus_queue.cc:260] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.545881 2238 raft_consensus.cc:2804] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.545976 2238 raft_consensus.cc:493] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.546047 2238 raft_consensus.cc:3060] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.547063 2238 raft_consensus.cc:515] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.547421 2238 leader_election.cc:290] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.547787 1459 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58408 (request call id 36) took 1002 ms. Trace:
I20260429 08:00:30.545912 2223 ts_tablet_manager.cc:1434] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.548923 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5561e3ecf0a1411d863de987110ce64f" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:30.549018 1730 raft_consensus.cc:3060] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.549317 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5561e3ecf0a1411d863de987110ce64f" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:30.549404 2005 raft_consensus.cc:3060] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.549921 1730 raft_consensus.cc:2468] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:30.550187 1803 leader_election.cc:304] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:30.550331 2005 raft_consensus.cc:2468] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:30.550482 2238 raft_consensus.cc:2804] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.550547 2238 raft_consensus.cc:697] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:30.547883 1459 rpcz_store.cc:276] 0429 08:00:29.545114 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:29.545169 (+ 55us) service_pool.cc:225] Handling call
0429 08:00:29.583984 (+ 38815us) catalog_manager.cc:2101] Acquired catalog manager lock
0429 08:00:29.584257 (+ 273us) catalog_manager.cc:2147] Created new table and tablet info
0429 08:00:30.543090 (+958833us) catalog_manager.cc:2173] Created new table in HMS catalog
0429 08:00:30.547627 (+ 4537us) catalog_manager.cc:2207] Wrote table and tablets to system table
0429 08:00:30.547704 (+ 77us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0429 08:00:30.547771 (+ 67us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0429 08:00:30.543565 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0429 08:00:30.543654 (+ 89us) write_op.cc:432] Acquiring schema lock in shared mode
0429 08:00:30.543658 (+ 4us) write_op.cc:435] Acquired schema lock
0429 08:00:30.543660 (+ 2us) tablet.cc:662] Decoding operations
0429 08:00:30.543721 (+ 61us) write_op.cc:620] Acquiring the partition lock for write op
0429 08:00:30.543729 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0429 08:00:30.543732 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0429 08:00:30.543782 (+ 50us) tablet.cc:701] Row locks acquired
0429 08:00:30.543784 (+ 2us) write_op.cc:260] PREPARE: finished
0429 08:00:30.543810 (+ 26us) write_op.cc:270] Start()
0429 08:00:30.543836 (+ 26us) write_op.cc:276] Timestamp: P: 1777449630543767 usec, L: 0
0429 08:00:30.543838 (+ 2us) op_driver.cc:348] REPLICATION: starting
0429 08:00:30.543969 (+ 131us) log.cc:844] Serialized 432 byte log entry
0429 08:00:30.547151 (+ 3182us) op_driver.cc:464] REPLICATION: finished
0429 08:00:30.547241 (+ 90us) write_op.cc:301] APPLY: starting
0429 08:00:30.547253 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0429 08:00:30.547286 (+ 33us) tablet.cc:1370] finished BulkCheckPresence
0429 08:00:30.547299 (+ 13us) tablet.cc:1372] starting ApplyRowOperation cycle
0429 08:00:30.547365 (+ 66us) tablet.cc:1383] finished ApplyRowOperation cycle
0429 08:00:30.547392 (+ 27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0429 08:00:30.547395 (+ 3us) write_op.cc:312] APPLY: finished
0429 08:00:30.547439 (+ 44us) log.cc:844] Serialized 28 byte log entry
0429 08:00:30.547486 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0429 08:00:30.547501 (+ 15us) write_op.cc:454] Released schema lock
0429 08:00:30.547506 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0429 08:00:30.547561 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0429 08:00:30.547566 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":922893,"Hive Metastore.run_cpu_time_us":235,"Hive Metastore.run_wall_time_us":35693,"mutex_wait_us":52,"child_traces":[["op",{"apply.queue_time_us":40,"apply.run_cpu_time_us":308,"apply.run_wall_time_us":307,"num_ops":2,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":484,"prepare.run_wall_time_us":485,"raft.queue_time_us":871,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":298,"replication_time_us":3289}]]}
I20260429 08:00:30.550686 2238 consensus_queue.cc:237] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.555868 1985 tablet_service.cc:1511] Processing CreateTablet for tablet 93630bad9fdd46e9b982cd1b44665433 (DEFAULT_TABLE table=default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.556110 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93630bad9fdd46e9b982cd1b44665433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.557576 1459 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58408:
table { table_name: "default.Table_a7449fdac83e405daed3c36aecdd0b32" } modify_external_catalogs: true
I20260429 08:00:30.557698 1459 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58408:
table { table_name: "default.Table_a7449fdac83e405daed3c36aecdd0b32" } modify_external_catalogs: true
I20260429 08:00:30.558130 1849 tablet_service.cc:1511] Processing CreateTablet for tablet 93630bad9fdd46e9b982cd1b44665433 (DEFAULT_TABLE table=default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.558388 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93630bad9fdd46e9b982cd1b44665433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.560317 2223 tablet_bootstrap.cc:492] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.560487 1711 tablet_service.cc:1511] Processing CreateTablet for tablet 93630bad9fdd46e9b982cd1b44665433 (DEFAULT_TABLE table=default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.560739 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93630bad9fdd46e9b982cd1b44665433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.561345 2223 tablet_bootstrap.cc:654] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.562827 2224 tablet_bootstrap.cc:492] T 93630bad9fdd46e9b982cd1b44665433 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.563784 2224 tablet_bootstrap.cc:654] T 93630bad9fdd46e9b982cd1b44665433 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.564682 2225 tablet_bootstrap.cc:492] T 93630bad9fdd46e9b982cd1b44665433 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.565593 2225 tablet_bootstrap.cc:654] T 93630bad9fdd46e9b982cd1b44665433 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.569211 2224 tablet_bootstrap.cc:492] T 93630bad9fdd46e9b982cd1b44665433 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.569308 2224 ts_tablet_manager.cc:1403] T 93630bad9fdd46e9b982cd1b44665433 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260429 08:00:30.569805 2224 raft_consensus.cc:359] T 93630bad9fdd46e9b982cd1b44665433 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.569926 2224 raft_consensus.cc:385] T 93630bad9fdd46e9b982cd1b44665433 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.569969 2224 raft_consensus.cc:740] T 93630bad9fdd46e9b982cd1b44665433 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.570102 2224 consensus_queue.cc:260] T 93630bad9fdd46e9b982cd1b44665433 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.570394 2224 ts_tablet_manager.cc:1434] T 93630bad9fdd46e9b982cd1b44665433 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.571560 2223 tablet_bootstrap.cc:492] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.571663 2223 ts_tablet_manager.cc:1403] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260429 08:00:30.572180 2223 raft_consensus.cc:359] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.572299 2223 raft_consensus.cc:385] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.572342 2223 raft_consensus.cc:740] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.572487 2223 consensus_queue.cc:260] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.572779 2223 ts_tablet_manager.cc:1434] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260429 08:00:30.573490 2225 tablet_bootstrap.cc:492] T 93630bad9fdd46e9b982cd1b44665433 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.573587 2225 ts_tablet_manager.cc:1403] T 93630bad9fdd46e9b982cd1b44665433 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260429 08:00:30.574138 2225 raft_consensus.cc:359] T 93630bad9fdd46e9b982cd1b44665433 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.574251 2225 raft_consensus.cc:385] T 93630bad9fdd46e9b982cd1b44665433 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.574298 2225 raft_consensus.cc:740] T 93630bad9fdd46e9b982cd1b44665433 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.574419 2225 consensus_queue.cc:260] T 93630bad9fdd46e9b982cd1b44665433 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.574705 2225 ts_tablet_manager.cc:1434] T 93630bad9fdd46e9b982cd1b44665433 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.587517 1458 catalog_manager.cc:2174] created HMS catalog entry for table [id=ba5133c5668141589469ba6e26f75c47]
I20260429 08:00:30.591972 1458 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58408 (request call id 37) took 1046 ms. Trace:
I20260429 08:00:30.592044 1458 rpcz_store.cc:276] 0429 08:00:29.545169 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:29.545203 (+ 34us) service_pool.cc:225] Handling call
0429 08:00:29.584603 (+ 39400us) catalog_manager.cc:2101] Acquired catalog manager lock
0429 08:00:29.584867 (+ 264us) catalog_manager.cc:2147] Created new table and tablet info
0429 08:00:30.587507 (+1002640us) catalog_manager.cc:2173] Created new table in HMS catalog
0429 08:00:30.591791 (+ 4284us) catalog_manager.cc:2207] Wrote table and tablets to system table
0429 08:00:30.591886 (+ 95us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0429 08:00:30.591956 (+ 70us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0429 08:00:30.587996 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0429 08:00:30.588090 (+ 94us) write_op.cc:432] Acquiring schema lock in shared mode
0429 08:00:30.588094 (+ 4us) write_op.cc:435] Acquired schema lock
0429 08:00:30.588095 (+ 1us) tablet.cc:662] Decoding operations
0429 08:00:30.588154 (+ 59us) write_op.cc:620] Acquiring the partition lock for write op
0429 08:00:30.588163 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0429 08:00:30.588166 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0429 08:00:30.588215 (+ 49us) tablet.cc:701] Row locks acquired
0429 08:00:30.588217 (+ 2us) write_op.cc:260] PREPARE: finished
0429 08:00:30.588242 (+ 25us) write_op.cc:270] Start()
0429 08:00:30.588265 (+ 23us) write_op.cc:276] Timestamp: P: 1777449630588195 usec, L: 0
0429 08:00:30.588267 (+ 2us) op_driver.cc:348] REPLICATION: starting
0429 08:00:30.588380 (+ 113us) log.cc:844] Serialized 432 byte log entry
0429 08:00:30.591164 (+ 2784us) op_driver.cc:464] REPLICATION: finished
0429 08:00:30.591318 (+ 154us) write_op.cc:301] APPLY: starting
0429 08:00:30.591330 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0429 08:00:30.591362 (+ 32us) tablet.cc:1370] finished BulkCheckPresence
0429 08:00:30.591376 (+ 14us) tablet.cc:1372] starting ApplyRowOperation cycle
0429 08:00:30.591441 (+ 65us) tablet.cc:1383] finished ApplyRowOperation cycle
0429 08:00:30.591466 (+ 25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0429 08:00:30.591472 (+ 6us) write_op.cc:312] APPLY: finished
0429 08:00:30.591521 (+ 49us) log.cc:844] Serialized 28 byte log entry
0429 08:00:30.591561 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0429 08:00:30.591574 (+ 13us) write_op.cc:454] Released schema lock
0429 08:00:30.591578 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0429 08:00:30.591626 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0429 08:00:30.591628 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":958011,"Hive Metastore.run_cpu_time_us":186,"Hive Metastore.run_wall_time_us":44395,"mutex_wait_us":44,"spinlock_wait_cycles":28928,"child_traces":[["op",{"apply.queue_time_us":114,"apply.run_cpu_time_us":301,"apply.run_wall_time_us":301,"num_ops":2,"prepare.queue_time_us":67,"prepare.run_cpu_time_us":456,"prepare.run_wall_time_us":457,"raft.queue_time_us":927,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":325,"replication_time_us":2874}]]}
I20260429 08:00:30.592926 1458 catalog_manager.cc:5671] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 353e59f343974ee68738535fb9029d30 (127.1.14.2). New cstate: current_term: 1 leader_uuid: "353e59f343974ee68738535fb9029d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:30.599959 1458 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_012320bc4c054b62be2e415bca912daf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:30.606859 1849 tablet_service.cc:1511] Processing CreateTablet for tablet 81c91c679c114775bd302d89f0996393 (DEFAULT_TABLE table=default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.606907 1711 tablet_service.cc:1511] Processing CreateTablet for tablet 81c91c679c114775bd302d89f0996393 (DEFAULT_TABLE table=default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.607179 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c91c679c114775bd302d89f0996393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.607187 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c91c679c114775bd302d89f0996393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.609202 2225 tablet_bootstrap.cc:492] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.609623 2223 tablet_bootstrap.cc:492] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.610113 2225 tablet_bootstrap.cc:654] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.610581 2223 tablet_bootstrap.cc:654] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.611436 1985 tablet_service.cc:1511] Processing CreateTablet for tablet 81c91c679c114775bd302d89f0996393 (DEFAULT_TABLE table=default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.611691 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c91c679c114775bd302d89f0996393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.613694 2224 tablet_bootstrap.cc:492] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.613848 2225 tablet_bootstrap.cc:492] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.613927 2225 ts_tablet_manager.cc:1403] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260429 08:00:30.614362 2232 raft_consensus.cc:493] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.614408 2225 raft_consensus.cc:359] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.614454 2232 raft_consensus.cc:515] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.614521 2225 raft_consensus.cc:385] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.614573 2225 raft_consensus.cc:740] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.614661 2224 tablet_bootstrap.cc:654] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.614719 2225 consensus_queue.cc:260] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.614827 2232 leader_election.cc:290] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.615036 2225 ts_tablet_manager.cc:1434] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.615649 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93630bad9fdd46e9b982cd1b44665433" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:30.615775 1730 raft_consensus.cc:2468] T 93630bad9fdd46e9b982cd1b44665433 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:30.617430 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93630bad9fdd46e9b982cd1b44665433" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:30.617568 2005 raft_consensus.cc:2468] T 93630bad9fdd46e9b982cd1b44665433 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:30.617846 1805 leader_election.cc:304] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.618957 2232 raft_consensus.cc:2804] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.619017 2232 raft_consensus.cc:493] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.619055 2232 raft_consensus.cc:3060] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.620401 2232 raft_consensus.cc:515] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.620823 2232 leader_election.cc:290] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.621290 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93630bad9fdd46e9b982cd1b44665433" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:30.621417 1730 raft_consensus.cc:3060] T 93630bad9fdd46e9b982cd1b44665433 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.622483 1730 raft_consensus.cc:2468] T 93630bad9fdd46e9b982cd1b44665433 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:30.622833 1803 leader_election.cc:304] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:30.624151 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93630bad9fdd46e9b982cd1b44665433" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:30.624286 2005 raft_consensus.cc:3060] T 93630bad9fdd46e9b982cd1b44665433 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.625259 2223 tablet_bootstrap.cc:492] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.625371 2223 ts_tablet_manager.cc:1403] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.001s
I20260429 08:00:30.625484 2005 raft_consensus.cc:2468] T 93630bad9fdd46e9b982cd1b44665433 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:30.625878 2223 raft_consensus.cc:359] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.625984 2223 raft_consensus.cc:385] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.626025 2223 raft_consensus.cc:740] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.626158 2232 raft_consensus.cc:2804] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.626278 2232 raft_consensus.cc:697] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:30.626413 2232 consensus_queue.cc:237] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.626806 2224 tablet_bootstrap.cc:492] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.626895 2224 ts_tablet_manager.cc:1403] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20260429 08:00:30.626181 2223 consensus_queue.cc:260] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.627365 2224 raft_consensus.cc:359] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.627454 2224 raft_consensus.cc:385] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.627482 2224 raft_consensus.cc:740] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.627514 2223 ts_tablet_manager.cc:1434] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:30.627594 2224 consensus_queue.cc:260] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.627851 2224 ts_tablet_manager.cc:1434] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.637046 1464 catalog_manager.cc:2174] created HMS catalog entry for table [id=8c3efbe07cdc40579fe7f3f193832006]
I20260429 08:00:30.639968 2232 raft_consensus.cc:493] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.640127 2232 raft_consensus.cc:515] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.641029 1464 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58408 (request call id 31) took 1096 ms. Trace:
I20260429 08:00:30.641096 1464 rpcz_store.cc:276] 0429 08:00:29.544809 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:29.544891 (+ 82us) service_pool.cc:225] Handling call
0429 08:00:29.585033 (+ 40142us) catalog_manager.cc:2101] Acquired catalog manager lock
0429 08:00:29.585303 (+ 270us) catalog_manager.cc:2147] Created new table and tablet info
0429 08:00:30.637037 (+1051734us) catalog_manager.cc:2173] Created new table in HMS catalog
0429 08:00:30.640849 (+ 3812us) catalog_manager.cc:2207] Wrote table and tablets to system table
0429 08:00:30.640944 (+ 95us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0429 08:00:30.641015 (+ 71us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0429 08:00:30.637546 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0429 08:00:30.637649 (+ 103us) write_op.cc:432] Acquiring schema lock in shared mode
0429 08:00:30.637653 (+ 4us) write_op.cc:435] Acquired schema lock
0429 08:00:30.637655 (+ 2us) tablet.cc:662] Decoding operations
0429 08:00:30.637720 (+ 65us) write_op.cc:620] Acquiring the partition lock for write op
0429 08:00:30.637729 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0429 08:00:30.637732 (+ 3us) tablet.cc:685] Acquiring locks for 2 operations
0429 08:00:30.637783 (+ 51us) tablet.cc:701] Row locks acquired
0429 08:00:30.637785 (+ 2us) write_op.cc:260] PREPARE: finished
0429 08:00:30.637813 (+ 28us) write_op.cc:270] Start()
0429 08:00:30.637839 (+ 26us) write_op.cc:276] Timestamp: P: 1777449630637760 usec, L: 0
0429 08:00:30.637840 (+ 1us) op_driver.cc:348] REPLICATION: starting
0429 08:00:30.637977 (+ 137us) log.cc:844] Serialized 432 byte log entry
0429 08:00:30.640334 (+ 2357us) op_driver.cc:464] REPLICATION: finished
0429 08:00:30.640434 (+ 100us) write_op.cc:301] APPLY: starting
0429 08:00:30.640447 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0429 08:00:30.640477 (+ 30us) tablet.cc:1370] finished BulkCheckPresence
0429 08:00:30.640492 (+ 15us) tablet.cc:1372] starting ApplyRowOperation cycle
0429 08:00:30.640557 (+ 65us) tablet.cc:1383] finished ApplyRowOperation cycle
0429 08:00:30.640606 (+ 49us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0429 08:00:30.640610 (+ 4us) write_op.cc:312] APPLY: finished
0429 08:00:30.640662 (+ 52us) log.cc:844] Serialized 28 byte log entry
0429 08:00:30.640705 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
0429 08:00:30.640717 (+ 12us) write_op.cc:454] Released schema lock
0429 08:00:30.640721 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0429 08:00:30.640769 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0429 08:00:30.640771 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1002012,"Hive Metastore.run_cpu_time_us":193,"Hive Metastore.run_wall_time_us":49516,"child_traces":[["op",{"apply.queue_time_us":68,"apply.run_cpu_time_us":327,"apply.run_wall_time_us":327,"num_ops":2,"prepare.queue_time_us":39,"prepare.run_cpu_time_us":528,"prepare.run_wall_time_us":528,"raft.queue_time_us":323,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":318,"replication_time_us":2471}]]}
I20260429 08:00:30.646688 2229 raft_consensus.cc:493] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.646790 2229 raft_consensus.cc:515] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.647192 2229 leader_election.cc:290] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.649293 1711 tablet_service.cc:1511] Processing CreateTablet for tablet 14b4f7286f694548abafa622ff5d5094 (DEFAULT_TABLE table=default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.649343 1985 tablet_service.cc:1511] Processing CreateTablet for tablet 14b4f7286f694548abafa622ff5d5094 (DEFAULT_TABLE table=default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.649545 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b4f7286f694548abafa622ff5d5094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.649613 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b4f7286f694548abafa622ff5d5094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.650857 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d1f856aca94369a644ecd753f61af0" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:30.650977 2004 raft_consensus.cc:2468] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:30.651546 2225 tablet_bootstrap.cc:492] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.651746 2224 tablet_bootstrap.cc:492] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.652489 2225 tablet_bootstrap.cc:654] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.652731 2224 tablet_bootstrap.cc:654] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.653242 1464 master_service.cc:954] ReplaceTablet: received request to replace tablet 5561e3ecf0a1411d863de987110ce64f from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:30.656351 2254 raft_consensus.cc:493] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.656435 2254 raft_consensus.cc:515] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.656818 2254 leader_election.cc:290] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:30.657604 1731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bed1294b08649efa2f6521e9cefe6b6" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:30.657730 1731 raft_consensus.cc:2468] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:30.659461 1938 leader_election.cc:304] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.659674 2254 raft_consensus.cc:2804] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.659729 2254 raft_consensus.cc:493] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.659765 2254 raft_consensus.cc:3060] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.660928 2254 raft_consensus.cc:515] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.661334 2254 leader_election.cc:290] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Requested vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:30.661355 2225 tablet_bootstrap.cc:492] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.661453 2225 ts_tablet_manager.cc:1403] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260429 08:00:30.661963 2225 raft_consensus.cc:359] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:30.662066 2225 raft_consensus.cc:385] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.662094 2225 raft_consensus.cc:740] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.662220 2225 consensus_queue.cc:260] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:30.662474 2225 ts_tablet_manager.cc:1434] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.664037 1731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bed1294b08649efa2f6521e9cefe6b6" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:30.664165 1731 raft_consensus.cc:3060] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.665279 1731 raft_consensus.cc:2468] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:30.665627 1938 leader_election.cc:304] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.666728 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d1f856aca94369a644ecd753f61af0" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:30.666872 1730 raft_consensus.cc:2468] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:30.667110 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bed1294b08649efa2f6521e9cefe6b6" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:30.667274 2005 raft_consensus.cc:2393] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6441a846e67a46159cef1413b6d06337 in current term 1: Already voted for candidate 873f2b4fab6f42738b2d41b4608a592a in this term.
I20260429 08:00:30.670253 2254 raft_consensus.cc:2804] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.670367 2254 raft_consensus.cc:697] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 1 LEADER]: Becoming Leader. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Running, Role: LEADER
I20260429 08:00:30.670517 2254 consensus_queue.cc:237] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:30.640544 2232 leader_election.cc:290] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.647656 1869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bed1294b08649efa2f6521e9cefe6b6" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:30.675410 1869 raft_consensus.cc:2468] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:30.650635 1849 tablet_service.cc:1511] Processing CreateTablet for tablet 14b4f7286f694548abafa622ff5d5094 (DEFAULT_TABLE table=default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.675946 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b4f7286f694548abafa622ff5d5094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.657388 1868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bed1294b08649efa2f6521e9cefe6b6" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:30.678607 1868 raft_consensus.cc:2468] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:30.662912 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bed1294b08649efa2f6521e9cefe6b6" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:30.665994 1805 leader_election.cc:304] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.679044 1867 raft_consensus.cc:3060] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.679211 2232 raft_consensus.cc:2804] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.679273 2232 raft_consensus.cc:493] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.679324 2232 raft_consensus.cc:3060] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.680181 2232 raft_consensus.cc:515] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.680662 2232 leader_election.cc:290] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.681044 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d1f856aca94369a644ecd753f61af0" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:30.681219 2005 raft_consensus.cc:3060] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.681946 1666 leader_election.cc:304] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters: 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:30.682176 2005 raft_consensus.cc:2468] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:30.682247 2229 raft_consensus.cc:2764] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260429 08:00:30.682509 1805 leader_election.cc:304] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.682708 2232 raft_consensus.cc:2804] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.682812 2232 raft_consensus.cc:697] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:30.682951 2232 consensus_queue.cc:237] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.683322 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d1f856aca94369a644ecd753f61af0" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:30.683431 1730 raft_consensus.cc:3060] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.684234 1730 raft_consensus.cc:2468] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:30.684522 1867 raft_consensus.cc:2468] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:30.688249 2223 tablet_bootstrap.cc:492] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.689191 2223 tablet_bootstrap.cc:654] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.693976 1464 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Sending DeleteTablet for 3 replicas of tablet 5561e3ecf0a1411d863de987110ce64f
I20260429 08:00:30.694425 1849 tablet_service.cc:1558] Processing DeleteTablet for tablet 5561e3ecf0a1411d863de987110ce64f with delete_type TABLET_DATA_DELETED (replaced by tablet 974c200acf6b4057a021739a1c7a7ba8) from {username='slave'} at 127.0.0.1:49014
I20260429 08:00:30.694651 2242 tablet_replica.cc:333] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:30.694778 2242 raft_consensus.cc:2243] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:30.694892 2242 pending_rounds.cc:70] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30: Trying to abort 1 pending ops.
I20260429 08:00:30.694914 2242 pending_rounds.cc:77] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7280433686736973824 op_type: NO_OP noop_request { }
I20260429 08:00:30.694954 2242 raft_consensus.cc:2889] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260429 08:00:30.694993 2242 raft_consensus.cc:2272] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.695564 2242 ts_tablet_manager.cc:1916] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.695569 1711 tablet_service.cc:1558] Processing DeleteTablet for tablet 5561e3ecf0a1411d863de987110ce64f with delete_type TABLET_DATA_DELETED (replaced by tablet 974c200acf6b4057a021739a1c7a7ba8) from {username='slave'} at 127.0.0.1:45318
I20260429 08:00:30.695703 2243 tablet_replica.cc:333] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:30.695804 2243 raft_consensus.cc:2243] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:30.695888 2243 raft_consensus.cc:2272] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.697507 1464 catalog_manager.cc:6741] ReplaceTablet: tablet 5561e3ecf0a1411d863de987110ce64f deleted and replaced by tablet 974c200acf6b4057a021739a1c7a7ba8
I20260429 08:00:30.697559 2242 ts_tablet_manager.cc:1929] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:30.697625 2242 log.cc:1199] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/5561e3ecf0a1411d863de987110ce64f
I20260429 08:00:30.697868 2242 ts_tablet_manager.cc:1950] T 5561e3ecf0a1411d863de987110ce64f P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:30.698477 1985 tablet_service.cc:1558] Processing DeleteTablet for tablet 5561e3ecf0a1411d863de987110ce64f with delete_type TABLET_DATA_DELETED (replaced by tablet 974c200acf6b4057a021739a1c7a7ba8) from {username='slave'} at 127.0.0.1:45446
I20260429 08:00:30.698644 2241 tablet_replica.cc:333] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:30.698750 2241 raft_consensus.cc:2243] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:30.698872 2241 raft_consensus.cc:2272] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.699358 2243 ts_tablet_manager.cc:1916] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.701397 2243 ts_tablet_manager.cc:1929] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260429 08:00:30.701467 2243 log.cc:1199] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/5561e3ecf0a1411d863de987110ce64f
I20260429 08:00:30.701673 2243 ts_tablet_manager.cc:1950] T 5561e3ecf0a1411d863de987110ce64f P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:30.702342 1451 catalog_manager.cc:5002] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): tablet 5561e3ecf0a1411d863de987110ce64f (table default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]) successfully deleted
I20260429 08:00:30.702858 1711 tablet_service.cc:1511] Processing CreateTablet for tablet 974c200acf6b4057a021739a1c7a7ba8 (DEFAULT_TABLE table=default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.703099 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 974c200acf6b4057a021739a1c7a7ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.704542 1849 tablet_service.cc:1511] Processing CreateTablet for tablet 974c200acf6b4057a021739a1c7a7ba8 (DEFAULT_TABLE table=default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.704993 2225 tablet_bootstrap.cc:492] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.705225 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 974c200acf6b4057a021739a1c7a7ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.706048 2225 tablet_bootstrap.cc:654] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.706804 2230 raft_consensus.cc:493] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.706918 2230 raft_consensus.cc:515] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.707294 2230 leader_election.cc:290] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:30.707556 1985 tablet_service.cc:1511] Processing CreateTablet for tablet 974c200acf6b4057a021739a1c7a7ba8 (DEFAULT_TABLE table=default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.707796 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 974c200acf6b4057a021739a1c7a7ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.708401 1464 catalog_manager.cc:5671] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 353e59f343974ee68738535fb9029d30 (127.1.14.2). New cstate: current_term: 1 leader_uuid: "353e59f343974ee68738535fb9029d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:30.710047 2241 ts_tablet_manager.cc:1916] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.710783 2223 tablet_bootstrap.cc:492] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.710870 2223 ts_tablet_manager.cc:1403] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20260429 08:00:30.711409 2223 raft_consensus.cc:359] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:30.711504 2223 raft_consensus.cc:385] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.711534 2223 raft_consensus.cc:740] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.711932 2241 ts_tablet_manager.cc:1929] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260429 08:00:30.711995 2241 log.cc:1199] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/5561e3ecf0a1411d863de987110ce64f
I20260429 08:00:30.712213 2241 ts_tablet_manager.cc:1950] T 5561e3ecf0a1411d863de987110ce64f P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:30.713238 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881e1249f58b4480ad5940e69ee49788" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:30.713356 1730 raft_consensus.cc:2468] T 881e1249f58b4480ad5940e69ee49788 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:30.713732 1938 leader_election.cc:304] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.713886 2230 raft_consensus.cc:2804] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.713928 2230 raft_consensus.cc:493] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.713966 2230 raft_consensus.cc:3060] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.715130 2230 raft_consensus.cc:515] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.715473 2230 leader_election.cc:290] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:30.715950 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881e1249f58b4480ad5940e69ee49788" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:30.716054 1730 raft_consensus.cc:3060] T 881e1249f58b4480ad5940e69ee49788 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.716922 1730 raft_consensus.cc:2468] T 881e1249f58b4480ad5940e69ee49788 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:30.717180 1938 leader_election.cc:304] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.717559 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881e1249f58b4480ad5940e69ee49788" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:30.717604 2230 raft_consensus.cc:2804] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.717667 2230 raft_consensus.cc:697] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [term 1 LEADER]: Becoming Leader. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Running, Role: LEADER
I20260429 08:00:30.717667 1867 raft_consensus.cc:2468] T 881e1249f58b4480ad5940e69ee49788 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:30.717794 2230 consensus_queue.cc:237] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.717867 1868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881e1249f58b4480ad5940e69ee49788" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:30.717939 1868 raft_consensus.cc:3060] T 881e1249f58b4480ad5940e69ee49788 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.719099 1868 raft_consensus.cc:2468] T 881e1249f58b4480ad5940e69ee49788 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:30.720285 1452 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet 5561e3ecf0a1411d863de987110ce64f (table default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]) successfully deleted
I20260429 08:00:30.721354 1453 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet 5561e3ecf0a1411d863de987110ce64f (table default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]) successfully deleted
I20260429 08:00:30.711653 2223 consensus_queue.cc:260] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:30.722308 2223 ts_tablet_manager.cc:1434] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20260429 08:00:30.722522 2223 tablet_bootstrap.cc:492] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.723677 2223 tablet_bootstrap.cc:654] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.725222 2224 tablet_bootstrap.cc:492] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.725310 2224 ts_tablet_manager.cc:1403] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.074s user 0.002s sys 0.000s
I20260429 08:00:30.725755 2224 raft_consensus.cc:359] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:30.725900 2224 raft_consensus.cc:385] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.725934 2224 raft_consensus.cc:740] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.726042 2224 consensus_queue.cc:260] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:30.726315 2224 ts_tablet_manager.cc:1434] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.726496 2224 tablet_bootstrap.cc:492] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.727475 2224 tablet_bootstrap.cc:654] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.735671 1464 catalog_manager.cc:5671] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 353e59f343974ee68738535fb9029d30 (127.1.14.2). New cstate: current_term: 1 leader_uuid: "353e59f343974ee68738535fb9029d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:30.738793 2225 tablet_bootstrap.cc:492] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.738900 2225 ts_tablet_manager.cc:1403] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20260429 08:00:30.739329 2225 raft_consensus.cc:359] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.739427 2225 raft_consensus.cc:385] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.739461 2225 raft_consensus.cc:740] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.739570 2225 consensus_queue.cc:260] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.739828 2225 ts_tablet_manager.cc:1434] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.745147 1464 catalog_manager.cc:5671] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a reported cstate change: term changed from 0 to 1, leader changed from <none> to 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3). New cstate: current_term: 1 leader_uuid: "873f2b4fab6f42738b2d41b4608a592a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: HEALTHY } } }
I20260429 08:00:30.745611 1464 catalog_manager.cc:5671] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a reported cstate change: term changed from 0 to 1, leader changed from <none> to 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3). New cstate: current_term: 1 leader_uuid: "873f2b4fab6f42738b2d41b4608a592a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:30.747646 2254 raft_consensus.cc:493] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.747761 2254 raft_consensus.cc:515] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.748220 2254 leader_election.cc:290] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:30.748812 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd90dd0711a448a18540c23f505ee522" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:30.748950 1730 raft_consensus.cc:2468] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:30.749331 1938 leader_election.cc:304] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.749938 2224 tablet_bootstrap.cc:492] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.750026 2224 ts_tablet_manager.cc:1403] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20260429 08:00:30.750533 2254 raft_consensus.cc:2804] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.750591 2254 raft_consensus.cc:493] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.750628 2254 raft_consensus.cc:3060] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.750571 2224 raft_consensus.cc:359] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.750687 2224 raft_consensus.cc:385] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.750718 2224 raft_consensus.cc:740] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.750844 2224 consensus_queue.cc:260] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.751101 2224 ts_tablet_manager.cc:1434] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.751626 2254 raft_consensus.cc:515] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.751940 2254 leader_election.cc:290] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:30.752408 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd90dd0711a448a18540c23f505ee522" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:30.752540 1730 raft_consensus.cc:3060] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.753501 1730 raft_consensus.cc:2468] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:30.753813 2229 raft_consensus.cc:493] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.753916 2229 raft_consensus.cc:515] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:30.753973 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd90dd0711a448a18540c23f505ee522" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:30.754078 1867 raft_consensus.cc:3060] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.754297 2229 leader_election.cc:290] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:30.754492 1938 leader_election.cc:304] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.754947 1867 raft_consensus.cc:2468] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:30.754954 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4f7286f694548abafa622ff5d5094" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:30.755072 2005 raft_consensus.cc:2468] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:30.755390 1667 leader_election.cc:304] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.755585 2229 raft_consensus.cc:2804] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.755635 2229 raft_consensus.cc:493] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.755671 2229 raft_consensus.cc:3060] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.756507 2229 raft_consensus.cc:515] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:30.756878 2229 leader_election.cc:290] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Requested vote from peers 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:30.757293 1869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4f7286f694548abafa622ff5d5094" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:30.757393 1869 raft_consensus.cc:3060] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.757382 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4f7286f694548abafa622ff5d5094" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:30.757476 2005 raft_consensus.cc:3060] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.758167 1869 raft_consensus.cc:2468] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:30.758322 2005 raft_consensus.cc:2468] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:30.758457 1666 leader_election.cc:304] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:30.758875 1868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd90dd0711a448a18540c23f505ee522" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:30.758999 1868 raft_consensus.cc:2376] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1. Re-sending same reply.
I20260429 08:00:30.759248 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b4f7286f694548abafa622ff5d5094" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:30.759325 1867 raft_consensus.cc:2376] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1. Re-sending same reply.
I20260429 08:00:30.760318 2229 raft_consensus.cc:2804] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.760403 2229 raft_consensus.cc:697] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Becoming Leader. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Running, Role: LEADER
I20260429 08:00:30.760517 2229 consensus_queue.cc:237] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:30.762730 2254 raft_consensus.cc:2804] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.762825 2254 raft_consensus.cc:697] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [term 1 LEADER]: Becoming Leader. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Running, Role: LEADER
I20260429 08:00:30.762948 2254 consensus_queue.cc:237] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.767766 2223 tablet_bootstrap.cc:492] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.767879 2223 ts_tablet_manager.cc:1403] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.000s
I20260429 08:00:30.768419 2223 raft_consensus.cc:359] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.768535 2223 raft_consensus.cc:385] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.768589 2223 raft_consensus.cc:740] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.768746 2223 consensus_queue.cc:260] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.769104 2223 ts_tablet_manager.cc:1434] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260429 08:00:30.780459 2254 raft_consensus.cc:493] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.780560 2254 raft_consensus.cc:515] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.780969 2254 leader_election.cc:290] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:30.781476 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c91c679c114775bd302d89f0996393" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:30.781607 1867 raft_consensus.cc:2468] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:30.781867 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c91c679c114775bd302d89f0996393" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:30.781912 1939 leader_election.cc:304] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.782012 1730 raft_consensus.cc:2468] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:30.782058 2254 raft_consensus.cc:2804] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.782130 2254 raft_consensus.cc:493] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.782207 2254 raft_consensus.cc:3060] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.782974 1464 catalog_manager.cc:5671] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a reported cstate change: term changed from 0 to 1, leader changed from <none> to 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3). New cstate: current_term: 1 leader_uuid: "873f2b4fab6f42738b2d41b4608a592a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: HEALTHY } } }
I20260429 08:00:30.783964 2254 raft_consensus.cc:515] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.784314 2254 leader_election.cc:290] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:30.784608 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c91c679c114775bd302d89f0996393" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:30.784682 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c91c679c114775bd302d89f0996393" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:30.784716 1867 raft_consensus.cc:3060] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.784782 1730 raft_consensus.cc:3060] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.785605 1730 raft_consensus.cc:2468] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:30.785605 1867 raft_consensus.cc:2468] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:30.785892 1938 leader_election.cc:304] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.786168 2254 raft_consensus.cc:2804] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.786667 2254 raft_consensus.cc:697] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [term 1 LEADER]: Becoming Leader. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Running, Role: LEADER
I20260429 08:00:30.786882 2254 consensus_queue.cc:237] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.796669 1464 catalog_manager.cc:5671] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6441a846e67a46159cef1413b6d06337 (127.1.14.1). New cstate: current_term: 1 leader_uuid: "6441a846e67a46159cef1413b6d06337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:30.803409 1464 catalog_manager.cc:5671] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a reported cstate change: term changed from 0 to 1, leader changed from <none> to 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3). New cstate: current_term: 1 leader_uuid: "873f2b4fab6f42738b2d41b4608a592a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: HEALTHY } } }
I20260429 08:00:30.809309 1464 master_service.cc:954] ReplaceTablet: received request to replace tablet 2efca20a4b054a0aa1a486017a2f35fa from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:30.815142 1464 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Sending DeleteTablet for 3 replicas of tablet 2efca20a4b054a0aa1a486017a2f35fa
I20260429 08:00:30.815668 1711 tablet_service.cc:1558] Processing DeleteTablet for tablet 2efca20a4b054a0aa1a486017a2f35fa with delete_type TABLET_DATA_DELETED (replaced by tablet a9336be80f2442f49cb80c4bb5368318) from {username='slave'} at 127.0.0.1:45318
I20260429 08:00:30.816046 2243 tablet_replica.cc:333] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:30.816185 2243 raft_consensus.cc:2243] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:30.816426 2243 pending_rounds.cc:70] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337: Trying to abort 1 pending ops.
I20260429 08:00:30.816521 2243 pending_rounds.cc:77] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7280433686301884416 op_type: NO_OP noop_request { }
I20260429 08:00:30.816659 2243 raft_consensus.cc:2889] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260429 08:00:30.816736 2243 raft_consensus.cc:2272] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.816918 1849 tablet_service.cc:1558] Processing DeleteTablet for tablet 2efca20a4b054a0aa1a486017a2f35fa with delete_type TABLET_DATA_DELETED (replaced by tablet a9336be80f2442f49cb80c4bb5368318) from {username='slave'} at 127.0.0.1:49014
I20260429 08:00:30.817081 2242 tablet_replica.cc:333] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:30.817198 2242 raft_consensus.cc:2243] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:30.817296 2242 raft_consensus.cc:2272] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.817461 2243 ts_tablet_manager.cc:1916] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.817641 2242 ts_tablet_manager.cc:1916] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.817731 1464 catalog_manager.cc:6741] ReplaceTablet: tablet 2efca20a4b054a0aa1a486017a2f35fa deleted and replaced by tablet a9336be80f2442f49cb80c4bb5368318
I20260429 08:00:30.817844 1464 master_service.cc:954] ReplaceTablet: received request to replace tablet e5f89d4dc7e44c2cbdeb939127f13c6e from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:30.819692 2242 ts_tablet_manager.cc:1929] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260429 08:00:30.819769 2242 log.cc:1199] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/2efca20a4b054a0aa1a486017a2f35fa
I20260429 08:00:30.820014 2242 ts_tablet_manager.cc:1950] T 2efca20a4b054a0aa1a486017a2f35fa P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:30.820722 1985 tablet_service.cc:1558] Processing DeleteTablet for tablet 2efca20a4b054a0aa1a486017a2f35fa with delete_type TABLET_DATA_DELETED (replaced by tablet a9336be80f2442f49cb80c4bb5368318) from {username='slave'} at 127.0.0.1:45446
I20260429 08:00:30.820920 2241 tablet_replica.cc:333] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:30.820924 1452 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet 2efca20a4b054a0aa1a486017a2f35fa (table default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]) successfully deleted
I20260429 08:00:30.821045 2241 raft_consensus.cc:2243] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:30.821151 2241 raft_consensus.cc:2272] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.821491 2241 ts_tablet_manager.cc:1916] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.823359 2241 ts_tablet_manager.cc:1929] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260429 08:00:30.823426 2241 log.cc:1199] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/2efca20a4b054a0aa1a486017a2f35fa
I20260429 08:00:30.823611 2241 ts_tablet_manager.cc:1950] T 2efca20a4b054a0aa1a486017a2f35fa P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:30.824510 1711 tablet_service.cc:1511] Processing CreateTablet for tablet a9336be80f2442f49cb80c4bb5368318 (DEFAULT_TABLE table=default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.824784 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9336be80f2442f49cb80c4bb5368318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.824774 1453 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet 2efca20a4b054a0aa1a486017a2f35fa (table default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]) successfully deleted
I20260429 08:00:30.827020 2225 tablet_bootstrap.cc:492] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.827127 1464 catalog_manager.cc:5958] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Sending DeleteTablet for 3 replicas of tablet e5f89d4dc7e44c2cbdeb939127f13c6e
I20260429 08:00:30.827363 2243 ts_tablet_manager.cc:1929] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:30.827442 2243 log.cc:1199] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/2efca20a4b054a0aa1a486017a2f35fa
I20260429 08:00:30.827723 2243 ts_tablet_manager.cc:1950] T 2efca20a4b054a0aa1a486017a2f35fa P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:30.828056 2225 tablet_bootstrap.cc:654] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.828845 1985 tablet_service.cc:1511] Processing CreateTablet for tablet a9336be80f2442f49cb80c4bb5368318 (DEFAULT_TABLE table=default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.829082 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9336be80f2442f49cb80c4bb5368318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.830024 1464 catalog_manager.cc:6741] ReplaceTablet: tablet e5f89d4dc7e44c2cbdeb939127f13c6e deleted and replaced by tablet 8a064c4234764686b945a49113a6cdc8
I20260429 08:00:30.830224 1464 master_service.cc:954] ReplaceTablet: received request to replace tablet e5f89d4dc7e44c2cbdeb939127f13c6e from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:30.831058 2224 tablet_bootstrap.cc:492] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.832003 2224 tablet_bootstrap.cc:654] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.833328 1848 tablet_service.cc:1558] Processing DeleteTablet for tablet e5f89d4dc7e44c2cbdeb939127f13c6e with delete_type TABLET_DATA_DELETED (replaced by tablet 8a064c4234764686b945a49113a6cdc8) from {username='slave'} at 127.0.0.1:49014
I20260429 08:00:30.833636 1849 tablet_service.cc:1511] Processing CreateTablet for tablet a9336be80f2442f49cb80c4bb5368318 (DEFAULT_TABLE table=default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.833724 1710 tablet_service.cc:1511] Processing CreateTablet for tablet 8a064c4234764686b945a49113a6cdc8 (DEFAULT_TABLE table=default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.833885 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9336be80f2442f49cb80c4bb5368318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.833927 1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a064c4234764686b945a49113a6cdc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.835907 2223 tablet_bootstrap.cc:492] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.833287 1451 catalog_manager.cc:5002] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): tablet 2efca20a4b054a0aa1a486017a2f35fa (table default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]) successfully deleted
I20260429 08:00:30.831030 1464 master_service.cc:954] ReplaceTablet: received request to replace tablet 2efca20a4b054a0aa1a486017a2f35fa from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:30.836874 2223 tablet_bootstrap.cc:654] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.836967 1464 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58408:
table { table_name: "default.Table_a5c75ef558e9422c9e29eaa5ad3e92ae" } modify_external_catalogs: true
I20260429 08:00:30.837145 1464 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58408:
table { table_name: "default.Table_a5c75ef558e9422c9e29eaa5ad3e92ae" } modify_external_catalogs: true
I20260429 08:00:30.837716 1984 tablet_service.cc:1511] Processing CreateTablet for tablet 8a064c4234764686b945a49113a6cdc8 (DEFAULT_TABLE table=default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.837955 1984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a064c4234764686b945a49113a6cdc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.837954 2223 tablet_bootstrap.cc:492] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.838022 2223 ts_tablet_manager.cc:1403] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260429 08:00:30.838485 2223 raft_consensus.cc:359] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.838577 2223 raft_consensus.cc:385] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.838608 2223 raft_consensus.cc:740] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.838726 2223 consensus_queue.cc:260] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.839004 2223 ts_tablet_manager.cc:1434] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.840198 1849 tablet_service.cc:1511] Processing CreateTablet for tablet 8a064c4234764686b945a49113a6cdc8 (DEFAULT_TABLE table=default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:30.840399 1849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a064c4234764686b945a49113a6cdc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:30.842115 2223 tablet_bootstrap.cc:492] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:30.843626 2223 tablet_bootstrap.cc:654] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.844177 2254 consensus_queue.cc:1048] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:30.847182 1985 tablet_service.cc:1558] Processing DeleteTablet for tablet e5f89d4dc7e44c2cbdeb939127f13c6e with delete_type TABLET_DATA_DELETED (replaced by tablet 8a064c4234764686b945a49113a6cdc8) from {username='slave'} at 127.0.0.1:45446
I20260429 08:00:30.847354 1711 tablet_service.cc:1558] Processing DeleteTablet for tablet e5f89d4dc7e44c2cbdeb939127f13c6e with delete_type TABLET_DATA_DELETED (replaced by tablet 8a064c4234764686b945a49113a6cdc8) from {username='slave'} at 127.0.0.1:45318
I20260429 08:00:30.847502 2243 tablet_replica.cc:333] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:30.847608 2243 raft_consensus.cc:2243] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:30.847707 2243 pending_rounds.cc:70] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337: Trying to abort 1 pending ops.
I20260429 08:00:30.847739 2243 pending_rounds.cc:77] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7280433686152003584 op_type: NO_OP noop_request { }
I20260429 08:00:30.847793 2243 raft_consensus.cc:2889] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260429 08:00:30.847877 2243 raft_consensus.cc:2272] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260429 08:00:30.848706 1938 consensus_peers.cc:597] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a -> Peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Couldn't send request to peer 6441a846e67a46159cef1413b6d06337. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260429 08:00:30.848867 2241 tablet_replica.cc:333] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:30.848974 2241 raft_consensus.cc:2243] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:30.849231 2241 raft_consensus.cc:2272] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.849442 2242 tablet_replica.cc:333] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:30.849536 2243 ts_tablet_manager.cc:1916] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.849550 2242 raft_consensus.cc:2243] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:30.849637 2242 raft_consensus.cc:2272] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:30.849939 2242 ts_tablet_manager.cc:1916] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.851500 2243 ts_tablet_manager.cc:1929] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:30.851562 2243 log.cc:1199] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/e5f89d4dc7e44c2cbdeb939127f13c6e
I20260429 08:00:30.851658 2242 ts_tablet_manager.cc:1929] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260429 08:00:30.851714 2242 log.cc:1199] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/e5f89d4dc7e44c2cbdeb939127f13c6e
I20260429 08:00:30.851795 2243 ts_tablet_manager.cc:1950] T e5f89d4dc7e44c2cbdeb939127f13c6e P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:30.851920 2242 ts_tablet_manager.cc:1950] T e5f89d4dc7e44c2cbdeb939127f13c6e P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:30.852603 1452 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet e5f89d4dc7e44c2cbdeb939127f13c6e (table default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]) successfully deleted
I20260429 08:00:30.852802 1451 catalog_manager.cc:5002] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): tablet e5f89d4dc7e44c2cbdeb939127f13c6e (table default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]) successfully deleted
I20260429 08:00:30.852946 2241 ts_tablet_manager.cc:1916] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:30.854820 2241 ts_tablet_manager.cc:1929] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:30.854909 2241 log.cc:1199] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/e5f89d4dc7e44c2cbdeb939127f13c6e
I20260429 08:00:30.855121 2241 ts_tablet_manager.cc:1950] T e5f89d4dc7e44c2cbdeb939127f13c6e P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:30.855798 1453 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet e5f89d4dc7e44c2cbdeb939127f13c6e (table default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]) successfully deleted
I20260429 08:00:30.861256 2225 tablet_bootstrap.cc:492] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.861291 2224 tablet_bootstrap.cc:492] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.861382 2224 ts_tablet_manager.cc:1403] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20260429 08:00:30.861375 2225 ts_tablet_manager.cc:1403] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.001s
I20260429 08:00:30.861773 2224 raft_consensus.cc:359] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.861873 2224 raft_consensus.cc:385] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.861904 2224 raft_consensus.cc:740] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.861862 2225 raft_consensus.cc:359] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.861974 2225 raft_consensus.cc:385] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.862007 2225 raft_consensus.cc:740] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.862010 2224 consensus_queue.cc:260] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.862135 2225 consensus_queue.cc:260] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.862237 2224 ts_tablet_manager.cc:1434] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:30.862407 2225 ts_tablet_manager.cc:1434] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260429 08:00:30.862439 2224 tablet_bootstrap.cc:492] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:30.862586 2225 tablet_bootstrap.cc:492] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:30.863667 2224 tablet_bootstrap.cc:654] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.863669 2225 tablet_bootstrap.cc:654] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:30.864974 2224 tablet_bootstrap.cc:492] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:30.865041 2224 ts_tablet_manager.cc:1403] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260429 08:00:30.865535 2224 raft_consensus.cc:359] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.865662 2224 raft_consensus.cc:385] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.865694 2224 raft_consensus.cc:740] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.865816 2224 consensus_queue.cc:260] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.866063 2224 ts_tablet_manager.cc:1434] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:30.873139 2223 tablet_bootstrap.cc:492] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:30.873225 2223 ts_tablet_manager.cc:1403] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.001s
I20260429 08:00:30.873625 2223 raft_consensus.cc:359] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.873733 2223 raft_consensus.cc:385] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.873766 2223 raft_consensus.cc:740] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.873879 2223 consensus_queue.cc:260] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.874094 2223 ts_tablet_manager.cc:1434] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260429 08:00:30.875577 2225 tablet_bootstrap.cc:492] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:30.875670 2225 ts_tablet_manager.cc:1403] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20260429 08:00:30.876137 2225 raft_consensus.cc:359] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.876243 2225 raft_consensus.cc:385] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:30.876284 2225 raft_consensus.cc:740] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:30.876413 2225 consensus_queue.cc:260] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.879822 2225 ts_tablet_manager.cc:1434] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260429 08:00:30.900753 2260 raft_consensus.cc:493] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.900887 2260 raft_consensus.cc:515] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.901427 2260 leader_election.cc:290] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.902143 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a064c4234764686b945a49113a6cdc8" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:30.902297 1867 raft_consensus.cc:2468] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:30.902559 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a064c4234764686b945a49113a6cdc8" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:30.902705 2005 raft_consensus.cc:2468] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:30.903043 1666 leader_election.cc:304] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:30.903515 2260 raft_consensus.cc:2804] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.903589 2260 raft_consensus.cc:493] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.903646 2260 raft_consensus.cc:3060] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.905040 2260 raft_consensus.cc:515] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.905485 2260 leader_election.cc:290] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Requested vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.906201 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a064c4234764686b945a49113a6cdc8" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:30.906327 1867 raft_consensus.cc:3060] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.907505 1867 raft_consensus.cc:2468] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:30.907866 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a064c4234764686b945a49113a6cdc8" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:30.907991 2005 raft_consensus.cc:3060] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.909147 2005 raft_consensus.cc:2468] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:30.909492 1667 leader_election.cc:304] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.909785 2260 raft_consensus.cc:2804] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.910544 2260 raft_consensus.cc:697] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Becoming Leader. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Running, Role: LEADER
I20260429 08:00:30.910719 2260 consensus_queue.cc:237] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.932014 2232 raft_consensus.cc:493] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.932157 2232 raft_consensus.cc:515] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.932593 2232 leader_election.cc:290] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.933061 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9336be80f2442f49cb80c4bb5368318" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:30.933200 1730 raft_consensus.cc:2468] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:30.933446 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9336be80f2442f49cb80c4bb5368318" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:30.933574 2005 raft_consensus.cc:2468] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:30.933898 1803 leader_election.cc:304] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:30.934286 2232 raft_consensus.cc:2804] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.934348 2232 raft_consensus.cc:493] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.934393 2232 raft_consensus.cc:3060] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.935245 2232 raft_consensus.cc:515] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.935582 2232 leader_election.cc:290] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.936022 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9336be80f2442f49cb80c4bb5368318" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:30.936139 1730 raft_consensus.cc:3060] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.936270 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9336be80f2442f49cb80c4bb5368318" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:30.936353 2005 raft_consensus.cc:3060] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.937007 1730 raft_consensus.cc:2468] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:30.937227 2005 raft_consensus.cc:2468] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:30.937487 1805 leader_election.cc:304] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.937692 2232 raft_consensus.cc:2804] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.937788 2232 raft_consensus.cc:697] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:30.937929 2232 consensus_queue.cc:237] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.989197 2232 raft_consensus.cc:493] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:30.989351 2232 raft_consensus.cc:515] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.989934 2232 leader_election.cc:290] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.990813 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "974c200acf6b4057a021739a1c7a7ba8" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:30.990984 1730 raft_consensus.cc:2468] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:30.991717 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "974c200acf6b4057a021739a1c7a7ba8" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:30.991843 1803 leader_election.cc:304] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:30.991868 2005 raft_consensus.cc:2468] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:30.992127 2232 raft_consensus.cc:2804] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:30.992188 2232 raft_consensus.cc:493] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:30.992226 2232 raft_consensus.cc:3060] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.993515 2232 raft_consensus.cc:515] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:30.993939 2232 leader_election.cc:290] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:30.994375 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "974c200acf6b4057a021739a1c7a7ba8" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:30.994509 2005 raft_consensus.cc:3060] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.995661 2005 raft_consensus.cc:2468] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:30.996127 1805 leader_election.cc:304] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:30.996683 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "974c200acf6b4057a021739a1c7a7ba8" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:30.996814 1730 raft_consensus.cc:3060] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:30.997864 1730 raft_consensus.cc:2468] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:30.998409 2232 raft_consensus.cc:2804] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:30.998594 2232 raft_consensus.cc:697] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:30.998772 2232 consensus_queue.cc:237] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.043284 1466 catalog_manager.cc:3502] renamed table default.table_9b98ec36c0514c4e9e1e5d745435032f [id=22977f026381472a97eeaf0d3112fa07] in HMS: new name default.table_00c8e8b0543b48458c08b780734269c6
W20260429 08:00:31.046636 1465 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ba60f2d687a9431288851fb68b310758 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:31.046690 1462 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_207de250815e4c1793355de8d028abec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:31.046777 1458 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_012320bc4c054b62be2e415bca912daf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260429 08:00:31.067332 2232 consensus_queue.cc:1048] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.074151 2232 consensus_queue.cc:1048] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.085146 1711 tablet_service.cc:1558] Processing DeleteTablet for tablet e5f89d4dc7e44c2cbdeb939127f13c6e with delete_type TABLET_DATA_DELETED (replaced by tablet 8a064c4234764686b945a49113a6cdc8) from {username='slave'} at 127.0.0.1:45318
I20260429 08:00:31.087359 2230 consensus_queue.cc:1048] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.088624 1985 tablet_service.cc:1558] Processing DeleteTablet for tablet e5f89d4dc7e44c2cbdeb939127f13c6e with delete_type TABLET_DATA_DELETED (replaced by tablet 8a064c4234764686b945a49113a6cdc8) from {username='slave'} at 127.0.0.1:45446
W20260429 08:00:31.085675 1451 catalog_manager.cc:4969] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): delete failed for tablet e5f89d4dc7e44c2cbdeb939127f13c6e because the tablet was not found. No further retry: Not found: Tablet not found: e5f89d4dc7e44c2cbdeb939127f13c6e
W20260429 08:00:31.089918 1453 catalog_manager.cc:4969] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): delete failed for tablet e5f89d4dc7e44c2cbdeb939127f13c6e because the tablet was not found. No further retry: Not found: Tablet not found: e5f89d4dc7e44c2cbdeb939127f13c6e
I20260429 08:00:31.084556 1466 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_91fe24cd92b444e1bd97440b6e584816"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:31.097466 2238 consensus_queue.cc:1048] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.106839 2232 consensus_queue.cc:1048] T 93630bad9fdd46e9b982cd1b44665433 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.114562 2230 consensus_queue.cc:1048] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.122622 2313 tablet.cc:1724] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:31.125682 2311 tablet.cc:1724] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:31.126431 2312 tablet.cc:1724] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:31.152511 2229 consensus_queue.cc:1048] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.154165 2230 consensus_queue.cc:1048] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.160831 2254 consensus_queue.cc:1048] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.164352 1460 catalog_manager.cc:3502] renamed table default.table_5bbc20bf027b4b4eb99c583f351cf1b1 [id=7642795dd6414b8eaf42383b571d3f91] in HMS: new name default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c
I20260429 08:00:31.174489 2260 consensus_queue.cc:1048] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.180470 2254 consensus_queue.cc:1048] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.187656 2230 consensus_queue.cc:1048] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.225378 2230 consensus_queue.cc:1048] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.240847 1463 catalog_manager.cc:3502] renamed table default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08] in HMS: new name default.table_03bb29fc9f854e85b7fc52f6523c6db0
I20260429 08:00:31.243562 2254 consensus_queue.cc:1048] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.303092 1457 catalog_manager.cc:3502] renamed table default.table_5ce59414814f4106ae9ad5a804275bb7 [id=a4ed989a19884204881820516d9704c3] in HMS: new name default.table_6795420cac01458198a3bf0876fd6092
I20260429 08:00:31.358855 2260 consensus_queue.cc:1048] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.367332 2229 consensus_queue.cc:1048] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.401787 2232 consensus_queue.cc:1048] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.417769 2232 consensus_queue.cc:1048] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.496237 2309 consensus_queue.cc:1048] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.500702 2238 consensus_queue.cc:1048] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:31.566258 2329 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1e6af049ae04c6e98cb5e609f9be472)
I20260429 08:00:31.566461 2329 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:31.567054 2329 leader_election.cc:290] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
I20260429 08:00:31.567500 1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 47 } } ignore_live_leader: false dest_uuid: "f1e6af049ae04c6e98cb5e609f9be472" is_pre_election: true
I20260429 08:00:31.577196 2152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 47 } } ignore_live_leader: false dest_uuid: "cd076a6196ef424a813003c9c5d53d42" is_pre_election: true
I20260429 08:00:31.577453 2152 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7c20d1745e54a9db1e0082a48ed06e4 in term 2.
I20260429 08:00:31.577832 1382 leader_election.cc:304] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4; no voters: f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:31.578053 2329 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260429 08:00:31.578094 2329 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f1e6af049ae04c6e98cb5e609f9be472)
I20260429 08:00:31.578130 2329 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 2 FOLLOWER]: Advancing to term 3
I20260429 08:00:31.579151 2329 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:31.579484 2329 leader_election.cc:290] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 3 election: Requested vote from peers f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
I20260429 08:00:31.579891 1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 47 } } ignore_live_leader: false dest_uuid: "f1e6af049ae04c6e98cb5e609f9be472"
I20260429 08:00:31.580482 2152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" candidate_term: 3 candidate_status { last_received { term: 2 index: 47 } } ignore_live_leader: false dest_uuid: "cd076a6196ef424a813003c9c5d53d42"
I20260429 08:00:31.580641 2152 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 2 FOLLOWER]: Advancing to term 3
I20260429 08:00:31.581729 2152 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7c20d1745e54a9db1e0082a48ed06e4 in term 3.
I20260429 08:00:31.582111 1382 leader_election.cc:304] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4; no voters: f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:31.582351 2329 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260429 08:00:31.582509 2329 raft_consensus.cc:697] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 3 LEADER]: Becoming Leader. State: Replica: d7c20d1745e54a9db1e0082a48ed06e4, State: Running, Role: LEADER
I20260429 08:00:31.582830 2329 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 2.47, Last appended by leader: 47, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:31.583810 2329 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7c20d1745e54a9db1e0082a48ed06e4. Latest consensus state: current_term: 3 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:31.583909 2329 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:31.584332 2335 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260429 08:00:31.586081 2335 catalog_manager.cc:679] Loaded metadata for table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]
I20260429 08:00:31.586392 2335 catalog_manager.cc:679] Loaded metadata for table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e]
I20260429 08:00:31.586632 2335 catalog_manager.cc:679] Loaded metadata for table default.table_5bbc20bf027b4b4eb99c583f351cf1b1 [id=7642795dd6414b8eaf42383b571d3f91]
I20260429 08:00:31.586894 2335 catalog_manager.cc:679] Loaded metadata for table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]
I20260429 08:00:31.587210 2335 catalog_manager.cc:679] Loaded metadata for table default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]
I20260429 08:00:31.587393 2335 catalog_manager.cc:679] Loaded metadata for table default.table_5ce59414814f4106ae9ad5a804275bb7 [id=a4ed989a19884204881820516d9704c3]
I20260429 08:00:31.587554 2335 catalog_manager.cc:679] Loaded metadata for table default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]
I20260429 08:00:31.587760 2335 catalog_manager.cc:679] Loaded metadata for table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]
I20260429 08:00:31.588007 2335 catalog_manager.cc:679] Loaded metadata for table default.table_a5c75ef558e9422c9e29eaa5ad3e92ae [id=e109005a4ef9476f8a0fc5021a89f7fb]
I20260429 08:00:31.588272 2335 catalog_manager.cc:679] Loaded metadata for table default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]
I20260429 08:00:31.589099 2332 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:31.589192 2332 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:31.589618 2152 raft_consensus.cc:1240] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 3 FOLLOWER]: Rejecting Update request from peer f1e6af049ae04c6e98cb5e609f9be472 for earlier term 2. Current term is 3. Ops: []
I20260429 08:00:31.590497 2332 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
I20260429 08:00:31.590632 2333 consensus_queue.cc:1059] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 }, Status: INVALID_TERM, Last received: 2.47, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260429 08:00:31.591147 1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd076a6196ef424a813003c9c5d53d42" candidate_term: 4 candidate_status { last_received { term: 2 index: 47 } } ignore_live_leader: false dest_uuid: "f1e6af049ae04c6e98cb5e609f9be472" is_pre_election: true
I20260429 08:00:31.591467 2333 raft_consensus.cc:3055] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 2 LEADER]: Stepping down as leader of term 2
I20260429 08:00:31.591547 2333 raft_consensus.cc:740] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1e6af049ae04c6e98cb5e609f9be472, State: Running, Role: LEADER
I20260429 08:00:31.591799 2333 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 2.47, Last appended by leader: 47, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:31.592126 2333 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 2 FOLLOWER]: Advancing to term 3
I20260429 08:00:31.594264 2335 tablet_loader.cc:96] loaded metadata for tablet 14b4f7286f694548abafa622ff5d5094 (table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006])
I20260429 08:00:31.594576 2335 tablet_loader.cc:96] loaded metadata for tablet 14d1f856aca94369a644ecd753f61af0 (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07])
I20260429 08:00:31.595223 2335 tablet_loader.cc:96] loaded metadata for tablet 6bed1294b08649efa2f6521e9cefe6b6 (table default.table_5bbc20bf027b4b4eb99c583f351cf1b1 [id=7642795dd6414b8eaf42383b571d3f91])
I20260429 08:00:31.595492 2335 tablet_loader.cc:96] loaded metadata for tablet 81c91c679c114775bd302d89f0996393 (table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47])
I20260429 08:00:31.595744 2335 tablet_loader.cc:96] loaded metadata for tablet 881e1249f58b4480ad5940e69ee49788 (table default.table_5ce59414814f4106ae9ad5a804275bb7 [id=a4ed989a19884204881820516d9704c3])
I20260429 08:00:31.596046 2335 tablet_loader.cc:96] loaded metadata for tablet 8a064c4234764686b945a49113a6cdc8 (table default.table_ac03de9e4e6343c89e902b1c64baee24 [id=8ec0fa88b9c645e1aa026d8e57ee5a08])
I20260429 08:00:31.596306 2335 tablet_loader.cc:96] loaded metadata for tablet 93630bad9fdd46e9b982cd1b44665433 (table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e])
I20260429 08:00:31.596557 2335 tablet_loader.cc:96] loaded metadata for tablet 974c200acf6b4057a021739a1c7a7ba8 (table default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753])
I20260429 08:00:31.596967 2335 tablet_loader.cc:96] loaded metadata for tablet a9336be80f2442f49cb80c4bb5368318 (table default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2])
I20260429 08:00:31.597234 2335 tablet_loader.cc:96] loaded metadata for tablet cd90dd0711a448a18540c23f505ee522 (table default.table_a5c75ef558e9422c9e29eaa5ad3e92ae [id=e109005a4ef9476f8a0fc5021a89f7fb])
I20260429 08:00:31.597545 2335 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260429 08:00:31.597597 1405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd076a6196ef424a813003c9c5d53d42" candidate_term: 4 candidate_status { last_received { term: 2 index: 47 } } ignore_live_leader: false dest_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" is_pre_election: true
I20260429 08:00:31.598070 2129 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42; no voters: d7c20d1745e54a9db1e0082a48ed06e4, f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:31.598305 2332 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260429 08:00:31.598556 2335 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:31.598644 2335 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260429 08:00:31.599409 2335 catalog_manager.cc:1514] Loading token signing keys...
I20260429 08:00:31.601420 2335 catalog_manager.cc:6055] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Loaded TSK: 0
I20260429 08:00:31.602169 2335 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260429 08:00:31.602746 2335 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260429 08:00:31.603334 2335 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 11
I20260429 08:00:31.665359 1459 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]
I20260429 08:00:31.697126 1462 catalog_manager.cc:2174] created HMS catalog entry for table [id=76db81fc69b8490d98c0496a830d00c2]
W20260429 08:00:31.697700 1462 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica f1e6af049ae04c6e98cb5e609f9be472 is not leader of this config: current role FOLLOWER
I20260429 08:00:31.715525 2052 heartbeater.cc:499] Master 127.1.14.62:41885 was elected leader, sending a full tablet report...
I20260429 08:00:31.717648 1395 catalog_manager.cc:5671] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6441a846e67a46159cef1413b6d06337 (127.1.14.1). New cstate: current_term: 1 leader_uuid: "6441a846e67a46159cef1413b6d06337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } }
I20260429 08:00:31.718062 1395 catalog_manager.cc:5671] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a reported cstate change: term changed from 0 to 1, leader changed from <none> to 353e59f343974ee68738535fb9029d30 (127.1.14.2). New cstate: current_term: 1 leader_uuid: "353e59f343974ee68738535fb9029d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } }
I20260429 08:00:31.718295 1395 catalog_manager.cc:5671] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a reported cstate change: term changed from 0 to 1, leader changed from <none> to 353e59f343974ee68738535fb9029d30 (127.1.14.2). New cstate: current_term: 1 leader_uuid: "353e59f343974ee68738535fb9029d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } }
I20260429 08:00:31.720801 2152 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 3 FOLLOWER]: Refusing update from remote peer d7c20d1745e54a9db1e0082a48ed06e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 47. Preceding OpId from leader: term: 3 index: 49. (index mismatch)
I20260429 08:00:31.720806 1476 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 3 FOLLOWER]: Refusing update from remote peer d7c20d1745e54a9db1e0082a48ed06e4: Log matching property violated. Preceding OpId in replica: term: 2 index: 47. Preceding OpId from leader: term: 3 index: 49. (index mismatch)
I20260429 08:00:31.721520 2329 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260429 08:00:31.721778 2334 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260429 08:00:31.723165 2332 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7c20d1745e54a9db1e0082a48ed06e4. Latest consensus state: current_term: 3 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:31.723160 2336 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7c20d1745e54a9db1e0082a48ed06e4. Latest consensus state: current_term: 3 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:31.723275 2332 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:31.723276 2336 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:31.724874 2342 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:31.724992 2342 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:31.725147 2336 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:31.725229 2336 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:31.725394 2332 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:31.725479 2332 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:31.725725 2341 mvcc.cc:204] Tried to move back new op lower bound from 7280433691523670016 to 7280433690966147072. Current Snapshot: MvccSnapshot[applied={T|T < 7280433691523670016}]
I20260429 08:00:31.725122 2342 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:31.727406 2342 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:31.728058 1458 catalog_manager.cc:2174] created HMS catalog entry for table [id=038ee5f1404b4d3ca452c21bfa0253e6]
W20260429 08:00:31.728468 1458 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica f1e6af049ae04c6e98cb5e609f9be472 is not leader of this config: current role FOLLOWER
I20260429 08:00:31.733958 1395 catalog_manager.cc:6216] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07] alter complete (version 1)
I20260429 08:00:31.786526 1461 catalog_manager.cc:3502] renamed table default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2] in HMS: new name default.table_99b9b733ad5c4a149389412905245938
I20260429 08:00:31.813140 1465 catalog_manager.cc:2174] created HMS catalog entry for table [id=4e473de5605545c8a22a1060cedb39cf]
W20260429 08:00:31.813706 1465 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica f1e6af049ae04c6e98cb5e609f9be472 is not leader of this config: current role FOLLOWER
I20260429 08:00:31.848263 1464 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_a5c75ef558e9422c9e29eaa5ad3e92ae [id=e109005a4ef9476f8a0fc5021a89f7fb]
W20260429 08:00:31.855625 1632 catalog_manager.cc:3939] Illegal state: an error occurred while updating the sys-catalog: replica f1e6af049ae04c6e98cb5e609f9be472 is not leader of this config: current role FOLLOWER
W20260429 08:00:31.855829 1632 hms_notification_log_listener.cc:329] Failed to handle Hive Metastore notification: 12 ALTER_TABLE default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c: Illegal state: an error occurred while updating the sys-catalog: replica f1e6af049ae04c6e98cb5e609f9be472 is not leader of this config: current role FOLLOWER
W20260429 08:00:31.855958 1632 hms_notification_log_listener.cc:143] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events: an error occurred while updating the sys-catalog: replica f1e6af049ae04c6e98cb5e609f9be472 is not leader of this config: current role FOLLOWER
I20260429 08:00:31.856155 1466 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58408 (request call id 59) took 1303 ms. Trace:
I20260429 08:00:31.856225 1466 rpcz_store.cc:276] 0429 08:00:30.552248 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:31.084462 (+532214us) service_pool.cc:225] Handling call
0429 08:00:31.856140 (+771678us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260429 08:00:31.857154 2058 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.14.61:33847)
W20260429 08:00:31.859422 1466 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.1.14.2:49047 (request call id 21) took 772 ms (client timeout 1000 ms). Trace:
W20260429 08:00:31.859483 1466 rpcz_store.cc:269] 0429 08:00:31.086605 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:31.858515 (+771910us) service_pool.cc:225] Handling call
0429 08:00:31.859399 (+ 884us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260429 08:00:31.860011 1466 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.1.14.3:41725 (request call id 21) took 768 ms (client timeout 1000 ms). Trace:
W20260429 08:00:31.860071 1466 rpcz_store.cc:269] 0429 08:00:31.091755 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:31.859605 (+767850us) service_pool.cc:225] Handling call
0429 08:00:31.860001 (+ 396us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260429 08:00:31.860527 1466 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.1.14.1:39731 (request call id 21) took 768 ms (client timeout 1000 ms). Trace:
W20260429 08:00:31.860596 1466 rpcz_store.cc:269] 0429 08:00:31.091805 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:31.860186 (+768381us) service_pool.cc:225] Handling call
0429 08:00:31.860516 (+ 330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260429 08:00:31.860809 1466 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:58408 (request call id 60) took 1308 ms. Trace:
I20260429 08:00:31.860850 1466 rpcz_store.cc:276] 0429 08:00:30.552328 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:31.860680 (+1308352us) service_pool.cc:225] Handling call
0429 08:00:31.860799 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260429 08:00:31.861090 1466 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:58408 (request call id 61) took 1264 ms. Trace:
I20260429 08:00:31.861142 1466 rpcz_store.cc:276] 0429 08:00:30.596297 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:31.860969 (+1264672us) service_pool.cc:225] Handling call
0429 08:00:31.861081 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260429 08:00:31.861366 1466 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58408 (request call id 62) took 1263 ms. Trace:
I20260429 08:00:31.861423 1466 rpcz_store.cc:276] 0429 08:00:30.597723 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:31.861234 (+1263511us) service_pool.cc:225] Handling call
0429 08:00:31.861357 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260429 08:00:31.861655 1466 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:58408 (request call id 63) took 1216 ms. Trace:
I20260429 08:00:31.861707 1466 rpcz_store.cc:276] 0429 08:00:30.644764 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:31.861538 (+1216774us) service_pool.cc:225] Handling call
0429 08:00:31.861647 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260429 08:00:31.861953 1466 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58408 (request call id 64) took 1206 ms. Trace:
I20260429 08:00:31.861999 1466 rpcz_store.cc:276] 0429 08:00:30.655738 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:31.861818 (+1206080us) service_pool.cc:225] Handling call
0429 08:00:31.861943 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260429 08:00:31.861960 1394 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34848:
name: "default.Table_91fe24cd92b444e1bd97440b6e584816"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:31.862269 1466 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58408 (request call id 65) took 1147 ms. Trace:
I20260429 08:00:31.862313 1466 rpcz_store.cc:276] 0429 08:00:30.714496 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:31.862114 (+1147618us) service_pool.cc:225] Handling call
0429 08:00:31.862258 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260429 08:00:31.862572 1466 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58408 (request call id 66) took 1109 ms. Trace:
W20260429 08:00:31.872512 2058 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.1.14.62:41885)
I20260429 08:00:31.875363 1393 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_34261e3d16e14d888f3f3fd3c436b4ad" } modify_external_catalogs: true
I20260429 08:00:31.875494 1393 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_34261e3d16e14d888f3f3fd3c436b4ad" } modify_external_catalogs: true
I20260429 08:00:31.875525 1392 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34848:
name: "default.Table_3b6223798dcd434c989986f1d5727b55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:31.875535 1388 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34848:
name: "default.Table_c566aa86e5284b17bb9bf76547b211f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:31.875665 1391 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_2aa9e902a68149cebca957e279cc82c4" } modify_external_catalogs: true
I20260429 08:00:31.875751 1391 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_2aa9e902a68149cebca957e279cc82c4" } modify_external_catalogs: true
I20260429 08:00:31.875813 1395 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_ec6b6e2df1d545c78484235081b96327" } modify_external_catalogs: true
I20260429 08:00:31.875912 1390 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34848:
name: "default.Table_9f5b102f2ff746f39f84bc047bfb16c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:31.875916 1395 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_ec6b6e2df1d545c78484235081b96327" } modify_external_catalogs: true
I20260429 08:00:31.876148 1464 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:58408 (request call id 58) took 1362 ms. Trace:
I20260429 08:00:31.876678 1464 rpcz_store.cc:276] 0429 08:00:30.513514 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:30.836855 (+323341us) service_pool.cc:225] Handling call
0429 08:00:31.080768 (+243913us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0429 08:00:31.876137 (+795369us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":732226,"Hive Metastore.run_cpu_time_us":162,"Hive Metastore.run_wall_time_us":35095}
I20260429 08:00:31.876956 1463 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:58408 (request call id 40) took 1675 ms. Trace:
I20260429 08:00:31.877053 1459 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:58408 (request call id 51) took 1421 ms. Trace:
I20260429 08:00:31.877103 1459 rpcz_store.cc:276] 0429 08:00:30.455231 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:30.557486 (+102255us) service_pool.cc:225] Handling call
0429 08:00:31.046466 (+488980us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0429 08:00:31.877043 (+830577us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":256528,"Hive Metastore.run_cpu_time_us":196,"Hive Metastore.run_wall_time_us":362029}
I20260429 08:00:31.877393 1457 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:58408 (request call id 49) took 1477 ms. Trace:
I20260429 08:00:31.877449 1457 rpcz_store.cc:276] 0429 08:00:30.400018 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:30.479166 (+ 79148us) service_pool.cc:225] Handling call
0429 08:00:30.481370 (+ 2204us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x5606c0db8c14. stack: 00007f2cabac50af 00007f2cabac569f 00007f2cab59cadd 0000560681f69dce 0000560681f69e21 00007f2cae8941f1 00007f2cae89415f 00007f2cadac6241 00007f2cafad0039 00007f2cafb95da3 00007f2cad45e409 00007f2cad4681d9 00007f2caca9f62f 00007f2caca9eee3 00007f2cacaa1bfd 00007f2cacaa053e
0429 08:00:31.046472 (+565102us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0429 08:00:31.877093 (+830621us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0429 08:00:31.877248 (+ 155us) catalog_manager.cc:3725] Apply alter schema
0429 08:00:31.877383 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":194206,"Hive Metastore.run_cpu_time_us":532,"Hive Metastore.run_wall_time_us":62298,"spinlock_wait_cycles":4445952}
I20260429 08:00:31.877712 1464 master_service.cc:954] ReplaceTablet: received request to replace tablet 14d1f856aca94369a644ecd753f61af0 from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:31.877769 1459 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58408 (request call id 68) took 1034 ms. Trace:
I20260429 08:00:31.877844 1459 rpcz_store.cc:276] 0429 08:00:30.843239 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:31.877675 (+1034436us) service_pool.cc:225] Handling call
0429 08:00:31.877762 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260429 08:00:31.877918 1464 master_service.cc:954] ReplaceTablet: received request to replace tablet 6bed1294b08649efa2f6521e9cefe6b6 from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:31.877950 1459 master_service.cc:954] ReplaceTablet: received request to replace tablet a9336be80f2442f49cb80c4bb5368318 from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:31.878042 1461 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:58408 (request call id 46) took 1621 ms. Trace:
I20260429 08:00:31.878069 1464 master_service.cc:954] ReplaceTablet: received request to replace tablet 14b4f7286f694548abafa622ff5d5094 from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:31.878119 1459 master_service.cc:954] ReplaceTablet: received request to replace tablet 8a064c4234764686b945a49113a6cdc8 from {username='slave'} at 127.0.0.1:58408
I20260429 08:00:31.876624 1460 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:58408 (request call id 48) took 1524 ms. Trace:
I20260429 08:00:31.878787 1460 rpcz_store.cc:276] 0429 08:00:30.351972 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:30.393208 (+ 41236us) service_pool.cc:225] Handling call
0429 08:00:31.046282 (+653074us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0429 08:00:31.876240 (+829958us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0429 08:00:31.876398 (+ 158us) catalog_manager.cc:3725] Apply alter schema
0429 08:00:31.876609 (+ 211us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":10755,"Hive Metastore.run_cpu_time_us":504,"Hive Metastore.run_wall_time_us":107020}
I20260429 08:00:31.878077 1461 rpcz_store.cc:276] 0429 08:00:30.256425 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:30.296259 (+ 39834us) service_pool.cc:225] Handling call
0429 08:00:31.046286 (+750027us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0429 08:00:31.877749 (+831463us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0429 08:00:31.877901 (+ 152us) catalog_manager.cc:3725] Apply alter schema
0429 08:00:31.878033 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":681561,"Hive Metastore.run_cpu_time_us":495,"Hive Metastore.run_wall_time_us":58457,"mutex_wait_us":818,"spinlock_wait_cycles":9088}
I20260429 08:00:31.877029 1463 rpcz_store.cc:276] 0429 08:00:30.201949 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:30.203108 (+ 1159us) service_pool.cc:225] Handling call
0429 08:00:31.046282 (+843174us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0429 08:00:31.876658 (+830376us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0429 08:00:31.876794 (+ 136us) catalog_manager.cc:3725] Apply alter schema
0429 08:00:31.876943 (+ 149us) inbound_call.cc:177] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":117815,"Hive Metastore.run_cpu_time_us":492,"Hive Metastore.run_wall_time_us":76456,"mutex_wait_us":26,"spinlock_wait_cycles":896}
I20260429 08:00:31.877717 1457 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58408 (request call id 67) took 1082 ms. Trace:
I20260429 08:00:31.884965 1457 rpcz_store.cc:276] 0429 08:00:30.794843 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:31.877584 (+1082741us) service_pool.cc:225] Handling call
0429 08:00:31.877708 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260429 08:00:31.887130 2058 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.1.14.62:41885)
W20260429 08:00:31.887534 2058 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.1.14.62:41885)
I20260429 08:00:31.862627 1466 rpcz_store.cc:276] 0429 08:00:30.752926 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:31.862412 (+1109486us) service_pool.cc:225] Handling call
0429 08:00:31.862561 (+ 149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260429 08:00:31.890082 1389 master_service.cc:954] ReplaceTablet: received request to replace tablet 14d1f856aca94369a644ecd753f61af0 from {username='slave'} at 127.0.0.1:34848
I20260429 08:00:31.890175 1387 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34848:
name: "default.Table_09d20647c80a4575b1d220f120d4c58a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:31.890440 1386 master_service.cc:954] ReplaceTablet: received request to replace tablet 6bed1294b08649efa2f6521e9cefe6b6 from {username='slave'} at 127.0.0.1:34848
I20260429 08:00:31.901113 1386 catalog_manager.cc:5958] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Sending DeleteTablet for 3 replicas of tablet 6bed1294b08649efa2f6521e9cefe6b6
I20260429 08:00:31.901216 1389 catalog_manager.cc:5958] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Sending DeleteTablet for 3 replicas of tablet 14d1f856aca94369a644ecd753f61af0
I20260429 08:00:31.901537 1386 catalog_manager.cc:6741] ReplaceTablet: tablet 6bed1294b08649efa2f6521e9cefe6b6 deleted and replaced by tablet 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:00:31.901726 1386 master_service.cc:954] ReplaceTablet: received request to replace tablet a9336be80f2442f49cb80c4bb5368318 from {username='slave'} at 127.0.0.1:34848
I20260429 08:00:31.903337 1778 heartbeater.cc:499] Master 127.1.14.62:41885 was elected leader, sending a full tablet report...
I20260429 08:00:31.903966 1985 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bed1294b08649efa2f6521e9cefe6b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d4069c79e8f4c36ba414169bd049b8f) from {username='slave'} at 127.0.0.1:51254
I20260429 08:00:31.904035 1984 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d1f856aca94369a644ecd753f61af0 with delete_type TABLET_DATA_DELETED (replaced by tablet c7bc3a1e6a8f4060b9c4132297e04f2f) from {username='slave'} at 127.0.0.1:51254
I20260429 08:00:31.901536 1389 catalog_manager.cc:6741] ReplaceTablet: tablet 14d1f856aca94369a644ecd753f61af0 deleted and replaced by tablet c7bc3a1e6a8f4060b9c4132297e04f2f
I20260429 08:00:31.904412 1389 master_service.cc:954] ReplaceTablet: received request to replace tablet 14b4f7286f694548abafa622ff5d5094 from {username='slave'} at 127.0.0.1:34848
I20260429 08:00:31.904678 2352 tablet.cc:1724] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:31.905074 2350 tablet.cc:1724] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:31.910441 2351 tablet.cc:1724] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:31.914906 1386 catalog_manager.cc:5958] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Sending DeleteTablet for 3 replicas of tablet a9336be80f2442f49cb80c4bb5368318
I20260429 08:00:31.915138 1386 catalog_manager.cc:6741] ReplaceTablet: tablet a9336be80f2442f49cb80c4bb5368318 deleted and replaced by tablet d1ee8252269e41e3bbe96fa3a43d4d9e
I20260429 08:00:31.915635 1985 tablet_service.cc:1558] Processing DeleteTablet for tablet a9336be80f2442f49cb80c4bb5368318 with delete_type TABLET_DATA_DELETED (replaced by tablet d1ee8252269e41e3bbe96fa3a43d4d9e) from {username='slave'} at 127.0.0.1:51254
I20260429 08:00:31.918264 1985 tablet_service.cc:1511] Processing CreateTablet for tablet 3d4069c79e8f4c36ba414169bd049b8f (DEFAULT_TABLE table=default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:31.918303 1984 tablet_service.cc:1511] Processing CreateTablet for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (DEFAULT_TABLE table=default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:31.918490 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d4069c79e8f4c36ba414169bd049b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:31.919677 1984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bc3a1e6a8f4060b9c4132297e04f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:31.920836 2359 tablet_bootstrap.cc:492] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:31.921954 1389 catalog_manager.cc:5958] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Sending DeleteTablet for 3 replicas of tablet 14b4f7286f694548abafa622ff5d5094
I20260429 08:00:31.922262 1389 catalog_manager.cc:6741] ReplaceTablet: tablet 14b4f7286f694548abafa622ff5d5094 deleted and replaced by tablet e2cfe56e4eca41c0b8ce2f3210f035ea
I20260429 08:00:31.922472 2359 tablet_bootstrap.cc:654] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:31.922732 1386 catalog_manager.cc:5763] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803) does not have the latest schema for tablet 8a064c4234764686b945a49113a6cdc8 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]). Expected version 1 got 0
I20260429 08:00:31.922811 1984 tablet_service.cc:1558] Processing DeleteTablet for tablet 14b4f7286f694548abafa622ff5d5094 with delete_type TABLET_DATA_DELETED (replaced by tablet e2cfe56e4eca41c0b8ce2f3210f035ea) from {username='slave'} at 127.0.0.1:51254
I20260429 08:00:31.923516 2359 tablet_bootstrap.cc:492] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:31.923591 2359 ts_tablet_manager.cc:1403] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260429 08:00:31.924054 2359 raft_consensus.cc:359] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.924154 2359 raft_consensus.cc:385] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:31.924187 2359 raft_consensus.cc:740] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:31.924309 2359 consensus_queue.cc:260] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.924602 2359 ts_tablet_manager.cc:1434] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:31.924772 2359 tablet_bootstrap.cc:492] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:31.925730 2359 tablet_bootstrap.cc:654] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:31.926988 1386 master_service.cc:954] ReplaceTablet: received request to replace tablet 8a064c4234764686b945a49113a6cdc8 from {username='slave'} at 127.0.0.1:34848
I20260429 08:00:31.928033 1389 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_00c8e8b0543b48458c08b780734269c6" } new_table_name: "default.Table_1bb6d84b6ef5474eb7270ecbd2c1af77" modify_external_catalogs: true
I20260429 08:00:31.929174 1849 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bed1294b08649efa2f6521e9cefe6b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d4069c79e8f4c36ba414169bd049b8f) from {username='slave'} at 127.0.0.1:40426
I20260429 08:00:31.929414 1848 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d1f856aca94369a644ecd753f61af0 with delete_type TABLET_DATA_DELETED (replaced by tablet c7bc3a1e6a8f4060b9c4132297e04f2f) from {username='slave'} at 127.0.0.1:40426
I20260429 08:00:31.929541 1847 tablet_service.cc:1558] Processing DeleteTablet for tablet a9336be80f2442f49cb80c4bb5368318 with delete_type TABLET_DATA_DELETED (replaced by tablet d1ee8252269e41e3bbe96fa3a43d4d9e) from {username='slave'} at 127.0.0.1:40426
I20260429 08:00:31.929790 1846 tablet_service.cc:1511] Processing CreateTablet for tablet 3d4069c79e8f4c36ba414169bd049b8f (DEFAULT_TABLE table=default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:31.930027 1846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d4069c79e8f4c36ba414169bd049b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:31.932001 1607 catalog_manager.cc:2772] Deleting table default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753] in response to Hive Metastore notification log event 15
I20260429 08:00:31.932358 1845 tablet_service.cc:1511] Processing CreateTablet for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (DEFAULT_TABLE table=default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:31.932626 1845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bc3a1e6a8f4060b9c4132297e04f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:31.933585 2363 tablet_bootstrap.cc:492] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:31.934422 2363 tablet_bootstrap.cc:654] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:31.934542 1844 tablet_service.cc:1558] Processing DeleteTablet for tablet 14b4f7286f694548abafa622ff5d5094 with delete_type TABLET_DATA_DELETED (replaced by tablet e2cfe56e4eca41c0b8ce2f3210f035ea) from {username='slave'} at 127.0.0.1:40426
I20260429 08:00:31.934973 2362 tablet_replica.cc:333] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:31.935141 2362 raft_consensus.cc:2243] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:31.935272 2362 raft_consensus.cc:2272] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:31.935760 2362 ts_tablet_manager.cc:1916] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:31.937268 2362 ts_tablet_manager.cc:1929] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:31.937320 2362 log.cc:1199] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/6bed1294b08649efa2f6521e9cefe6b6
I20260429 08:00:31.937557 2362 ts_tablet_manager.cc:1950] T 6bed1294b08649efa2f6521e9cefe6b6 P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:31.937951 2363 tablet_bootstrap.cc:492] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:31.938014 2363 ts_tablet_manager.cc:1403] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260429 08:00:31.938066 2362 tablet_replica.cc:333] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:31.938163 2362 raft_consensus.cc:2243] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:31.938206 1710 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d1f856aca94369a644ecd753f61af0 with delete_type TABLET_DATA_DELETED (replaced by tablet c7bc3a1e6a8f4060b9c4132297e04f2f) from {username='slave'} at 127.0.0.1:48104
I20260429 08:00:31.938346 2362 raft_consensus.cc:2272] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:31.938408 2363 raft_consensus.cc:359] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.938493 2363 raft_consensus.cc:385] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:31.938534 2363 raft_consensus.cc:740] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:31.938630 1710 tablet_service.cc:1511] Processing CreateTablet for tablet d1ee8252269e41e3bbe96fa3a43d4d9e (DEFAULT_TABLE table=default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:31.938648 2363 consensus_queue.cc:260] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.938838 1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ee8252269e41e3bbe96fa3a43d4d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:31.938908 2363 ts_tablet_manager.cc:1434] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:31.939055 1916 heartbeater.cc:499] Master 127.1.14.62:41885 was elected leader, sending a full tablet report...
I20260429 08:00:31.939054 1709 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bed1294b08649efa2f6521e9cefe6b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d4069c79e8f4c36ba414169bd049b8f) from {username='slave'} at 127.0.0.1:48104
I20260429 08:00:31.939203 1708 tablet_service.cc:1558] Processing DeleteTablet for tablet a9336be80f2442f49cb80c4bb5368318 with delete_type TABLET_DATA_DELETED (replaced by tablet d1ee8252269e41e3bbe96fa3a43d4d9e) from {username='slave'} at 127.0.0.1:48104
I20260429 08:00:31.939409 1707 tablet_service.cc:1511] Processing CreateTablet for tablet 3d4069c79e8f4c36ba414169bd049b8f (DEFAULT_TABLE table=default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:31.939610 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d4069c79e8f4c36ba414169bd049b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:31.940778 2362 ts_tablet_manager.cc:1916] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:31.940784 1706 tablet_service.cc:1511] Processing CreateTablet for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (DEFAULT_TABLE table=default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:31.940994 1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bc3a1e6a8f4060b9c4132297e04f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:31.942524 2362 ts_tablet_manager.cc:1929] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:31.942608 2362 log.cc:1199] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/14d1f856aca94369a644ecd753f61af0
I20260429 08:00:31.942843 2362 ts_tablet_manager.cc:1950] T 14d1f856aca94369a644ecd753f61af0 P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:31.942901 1705 tablet_service.cc:1558] Processing DeleteTablet for tablet 14b4f7286f694548abafa622ff5d5094 with delete_type TABLET_DATA_DELETED (replaced by tablet e2cfe56e4eca41c0b8ce2f3210f035ea) from {username='slave'} at 127.0.0.1:48104
I20260429 08:00:31.943329 2362 tablet_replica.cc:333] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:31.943431 2362 raft_consensus.cc:2243] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:31.943583 2362 raft_consensus.cc:2272] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:31.944029 2362 ts_tablet_manager.cc:1916] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:31.944432 2363 tablet_bootstrap.cc:492] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:31.945048 2365 tablet_replica.cc:333] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:31.945154 2365 raft_consensus.cc:2243] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:31.945283 2365 raft_consensus.cc:2272] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:31.945255 1985 tablet_service.cc:1511] Processing CreateTablet for tablet d1ee8252269e41e3bbe96fa3a43d4d9e (DEFAULT_TABLE table=default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:31.945879 2363 tablet_bootstrap.cc:654] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:31.946393 2362 ts_tablet_manager.cc:1929] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:31.946452 2362 log.cc:1199] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/a9336be80f2442f49cb80c4bb5368318
I20260429 08:00:31.946745 2366 tablet_bootstrap.cc:492] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:31.946974 2365 ts_tablet_manager.cc:1916] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:31.948019 2366 tablet_bootstrap.cc:654] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:31.948975 2365 ts_tablet_manager.cc:1929] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:31.949051 2363 tablet_bootstrap.cc:492] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:31.949122 2363 ts_tablet_manager.cc:1403] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260429 08:00:31.949173 2365 log.cc:1199] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/14d1f856aca94369a644ecd753f61af0
I20260429 08:00:31.949453 2365 ts_tablet_manager.cc:1950] T 14d1f856aca94369a644ecd753f61af0 P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:31.949644 2363 raft_consensus.cc:359] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.949726 2363 raft_consensus.cc:385] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:31.949755 2363 raft_consensus.cc:740] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:31.949903 2238 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:31.949946 2365 tablet_replica.cc:333] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:31.949965 2238 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.950033 2365 raft_consensus.cc:2243] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:31.950124 2365 raft_consensus.cc:2272] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:31.949129 2362 ts_tablet_manager.cc:1950] T a9336be80f2442f49cb80c4bb5368318 P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:31.950265 2238 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:31.950683 2362 tablet_replica.cc:333] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:31.950795 2362 raft_consensus.cc:2243] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:31.950867 2362 raft_consensus.cc:2272] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:31.951108 2363 consensus_queue.cc:260] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.951378 2362 ts_tablet_manager.cc:1916] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:31.951706 1381 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet 6bed1294b08649efa2f6521e9cefe6b6 (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]) successfully deleted
I20260429 08:00:31.951833 1381 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet 14d1f856aca94369a644ecd753f61af0 (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]) successfully deleted
I20260429 08:00:31.951924 1381 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet a9336be80f2442f49cb80c4bb5368318 (table default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]) successfully deleted
I20260429 08:00:31.952406 1844 tablet_service.cc:1511] Processing CreateTablet for tablet d1ee8252269e41e3bbe96fa3a43d4d9e (DEFAULT_TABLE table=default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:31.952698 1844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ee8252269e41e3bbe96fa3a43d4d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:31.953161 2363 ts_tablet_manager.cc:1434] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260429 08:00:31.953557 2365 ts_tablet_manager.cc:1916] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:31.954516 2363 tablet_bootstrap.cc:492] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:31.955307 2363 tablet_bootstrap.cc:654] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:31.956175 2366 tablet_bootstrap.cc:492] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:31.956248 2366 ts_tablet_manager.cc:1403] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260429 08:00:31.956342 2352 tablet.cc:1724] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:31.956588 1386 catalog_manager.cc:5958] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Sending DeleteTablet for 3 replicas of tablet 8a064c4234764686b945a49113a6cdc8
I20260429 08:00:31.956830 1386 catalog_manager.cc:6741] ReplaceTablet: tablet 8a064c4234764686b945a49113a6cdc8 deleted and replaced by tablet 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:00:31.958573 1983 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a064c4234764686b945a49113a6cdc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 29d7fe3ebc3148a9be321460da8abdb5) from {username='slave'} at 127.0.0.1:51254
I20260429 08:00:31.958873 2362 ts_tablet_manager.cc:1929] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:31.958981 2362 log.cc:1199] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/14b4f7286f694548abafa622ff5d5094
I20260429 08:00:31.959409 2351 tablet.cc:1724] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:31.960148 1380 catalog_manager.cc:5002] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): tablet 14d1f856aca94369a644ecd753f61af0 (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]) successfully deleted
I20260429 08:00:31.960376 2362 ts_tablet_manager.cc:1950] T 14b4f7286f694548abafa622ff5d5094 P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:31.960894 1705 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a064c4234764686b945a49113a6cdc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 29d7fe3ebc3148a9be321460da8abdb5) from {username='slave'} at 127.0.0.1:48104
I20260429 08:00:31.961191 1381 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet 14b4f7286f694548abafa622ff5d5094 (table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]) successfully deleted
W20260429 08:00:31.961315 1803 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:00:31.961602 2365 ts_tablet_manager.cc:1929] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:31.961724 2365 log.cc:1199] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/6bed1294b08649efa2f6521e9cefe6b6
I20260429 08:00:31.962026 2365 ts_tablet_manager.cc:1950] T 6bed1294b08649efa2f6521e9cefe6b6 P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:31.962606 2365 tablet_replica.cc:333] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:31.962970 2366 raft_consensus.cc:359] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.963119 2366 raft_consensus.cc:385] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:31.963194 2366 raft_consensus.cc:740] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:31.963346 2366 consensus_queue.cc:260] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.963901 1380 catalog_manager.cc:5002] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): tablet 6bed1294b08649efa2f6521e9cefe6b6 (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]) successfully deleted
I20260429 08:00:31.965167 2366 ts_tablet_manager.cc:1434] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260429 08:00:31.965999 2365 raft_consensus.cc:2243] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:31.966167 2365 raft_consensus.cc:2272] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:31.966645 2366 tablet_bootstrap.cc:492] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:31.966784 2365 ts_tablet_manager.cc:1916] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:31.967664 2366 tablet_bootstrap.cc:654] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:31.968472 2365 ts_tablet_manager.cc:1929] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:31.968600 2365 log.cc:1199] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/a9336be80f2442f49cb80c4bb5368318
I20260429 08:00:31.968636 2366 tablet_bootstrap.cc:492] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:31.968734 2366 ts_tablet_manager.cc:1403] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:31.969233 2366 raft_consensus.cc:359] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.969323 2366 raft_consensus.cc:385] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:31.969359 2366 raft_consensus.cc:740] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:31.969451 2366 consensus_queue.cc:260] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.969669 2366 ts_tablet_manager.cc:1434] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:31.969820 2366 tablet_bootstrap.cc:492] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:31.970113 1983 tablet_service.cc:1511] Processing CreateTablet for tablet e2cfe56e4eca41c0b8ce2f3210f035ea (DEFAULT_TABLE table=default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:31.970602 2366 tablet_bootstrap.cc:654] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:31.970582 1707 tablet_service.cc:1511] Processing CreateTablet for tablet e2cfe56e4eca41c0b8ce2f3210f035ea (DEFAULT_TABLE table=default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:31.970748 1844 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a064c4234764686b945a49113a6cdc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 29d7fe3ebc3148a9be321460da8abdb5) from {username='slave'} at 127.0.0.1:40426
I20260429 08:00:31.971256 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2cfe56e4eca41c0b8ce2f3210f035ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:31.971968 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4069c79e8f4c36ba414169bd049b8f" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:31.972098 2005 raft_consensus.cc:2468] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:31.972968 1805 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters: 6441a846e67a46159cef1413b6d06337
I20260429 08:00:31.973201 2238 raft_consensus.cc:2804] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:31.973254 2238 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:31.973289 2238 raft_consensus.cc:3060] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:31.973340 1844 tablet_service.cc:1511] Processing CreateTablet for tablet e2cfe56e4eca41c0b8ce2f3210f035ea (DEFAULT_TABLE table=default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:31.973528 1844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2cfe56e4eca41c0b8ce2f3210f035ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:31.974100 2238 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.974437 2238 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:31.974634 1985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ee8252269e41e3bbe96fa3a43d4d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:31.975354 2362 tablet_replica.cc:333] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:31.975509 2362 raft_consensus.cc:2243] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:31.975648 2362 raft_consensus.cc:2272] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:31.976141 2362 ts_tablet_manager.cc:1916] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:31.976141 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4069c79e8f4c36ba414169bd049b8f" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:31.976233 2004 raft_consensus.cc:3060] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:31.976656 1983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2cfe56e4eca41c0b8ce2f3210f035ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:31.977195 2004 raft_consensus.cc:2468] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:31.977438 1805 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:31.977766 2362 ts_tablet_manager.cc:1929] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:31.977792 2238 raft_consensus.cc:2804] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:31.977820 2362 log.cc:1199] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/8a064c4234764686b945a49113a6cdc8
I20260429 08:00:31.977867 2238 raft_consensus.cc:697] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:31.978034 2362 ts_tablet_manager.cc:1950] T 8a064c4234764686b945a49113a6cdc8 P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:31.978431 2365 ts_tablet_manager.cc:1950] T a9336be80f2442f49cb80c4bb5368318 P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:31.978899 2365 tablet_replica.cc:333] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:31.977984 2238 consensus_queue.cc:237] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.979020 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4069c79e8f4c36ba414169bd049b8f" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:31.981134 2350 tablet.cc:1724] T 881e1249f58b4480ad5940e69ee49788 P 873f2b4fab6f42738b2d41b4608a592a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:31.981514 2365 raft_consensus.cc:2243] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Raft consensus shutting down.
W20260429 08:00:31.981732 1803 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Illegal state: must be running to vote when last-logged opid is not known
I20260429 08:00:31.981925 2365 raft_consensus.cc:2272] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:31.981983 1381 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet 8a064c4234764686b945a49113a6cdc8 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]) successfully deleted
I20260429 08:00:31.982549 2365 ts_tablet_manager.cc:1916] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:31.983136 2363 tablet_bootstrap.cc:492] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:31.983213 2363 ts_tablet_manager.cc:1403] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20260429 08:00:31.983422 2366 tablet_bootstrap.cc:492] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:31.983485 2366 ts_tablet_manager.cc:1403] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20260429 08:00:31.983620 2363 raft_consensus.cc:359] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.983693 2363 raft_consensus.cc:385] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:31.983721 2363 raft_consensus.cc:740] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:31.983810 2363 consensus_queue.cc:260] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.983857 2366 raft_consensus.cc:359] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.983929 2366 raft_consensus.cc:385] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:31.983954 2366 raft_consensus.cc:740] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:31.984056 2363 ts_tablet_manager.cc:1434] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:31.984041 2366 consensus_queue.cc:260] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.984213 2363 tablet_bootstrap.cc:492] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:31.984305 2366 ts_tablet_manager.cc:1434] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:31.985167 2363 tablet_bootstrap.cc:654] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:31.986111 2351 tablet.cc:1724] T 881e1249f58b4480ad5940e69ee49788 P 353e59f343974ee68738535fb9029d30: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:31.987394 2366 tablet_bootstrap.cc:492] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:31.988247 2366 tablet_bootstrap.cc:654] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:31.989163 2366 tablet_bootstrap.cc:492] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:31.989234 2366 ts_tablet_manager.cc:1403] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:31.989594 2366 raft_consensus.cc:359] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.989686 2366 raft_consensus.cc:385] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:31.989727 2366 raft_consensus.cc:740] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:31.989822 2366 consensus_queue.cc:260] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.989890 1380 catalog_manager.cc:5002] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): tablet a9336be80f2442f49cb80c4bb5368318 (table default.table_5d064684efbd44ca80193c9417a8308f [id=a7b78c42cfef44fcafe72b4f588505c2]) successfully deleted
I20260429 08:00:31.990034 2366 ts_tablet_manager.cc:1434] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:31.991459 2308 raft_consensus.cc:493] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:31.991536 2308 raft_consensus.cc:515] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.991869 2308 leader_election.cc:290] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:31.991948 2350 tablet.cc:1724] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:31.991955 2365 ts_tablet_manager.cc:1929] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:31.992121 2365 log.cc:1199] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/14b4f7286f694548abafa622ff5d5094
I20260429 08:00:31.992374 2365 ts_tablet_manager.cc:1950] T 14b4f7286f694548abafa622ff5d5094 P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:31.992798 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee8252269e41e3bbe96fa3a43d4d9e" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:31.992887 2365 tablet_replica.cc:333] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:31.992969 2365 raft_consensus.cc:2243] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:31.993101 2365 raft_consensus.cc:2272] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260429 08:00:31.993283 1805 leader_election.cc:343] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260429 08:00:31.993606 2365 ts_tablet_manager.cc:1916] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:31.994055 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee8252269e41e3bbe96fa3a43d4d9e" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:31.994170 1729 raft_consensus.cc:2468] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:31.994642 1803 leader_election.cc:304] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters: 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:31.994844 2308 raft_consensus.cc:2804] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:31.994897 2308 raft_consensus.cc:493] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:31.994948 2308 raft_consensus.cc:3060] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:31.995621 2365 ts_tablet_manager.cc:1929] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:31.995725 2365 log.cc:1199] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/8a064c4234764686b945a49113a6cdc8
I20260429 08:00:31.996017 2365 ts_tablet_manager.cc:1950] T 8a064c4234764686b945a49113a6cdc8 P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:31.995996 2308 raft_consensus.cc:515] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.996338 2308 leader_election.cc:290] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:31.996740 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee8252269e41e3bbe96fa3a43d4d9e" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:31.996870 1380 catalog_manager.cc:5002] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): tablet 14b4f7286f694548abafa622ff5d5094 (table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]) successfully deleted
W20260429 08:00:31.997244 1805 leader_election.cc:343] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260429 08:00:31.997641 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee8252269e41e3bbe96fa3a43d4d9e" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:31.997736 1729 raft_consensus.cc:3060] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:31.997996 2363 tablet_bootstrap.cc:492] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:31.998075 2363 ts_tablet_manager.cc:1403] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20260429 08:00:31.998508 1729 raft_consensus.cc:2468] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:31.998508 2363 raft_consensus.cc:359] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.998588 2363 raft_consensus.cc:385] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:31.998617 2363 raft_consensus.cc:740] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:31.998721 2363 consensus_queue.cc:260] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:31.998962 2363 ts_tablet_manager.cc:1434] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260429 08:00:31.999050 2352 tablet.cc:1724] T 881e1249f58b4480ad5940e69ee49788 P 6441a846e67a46159cef1413b6d06337: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:31.999140 1380 catalog_manager.cc:5002] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): tablet 8a064c4234764686b945a49113a6cdc8 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]) successfully deleted
I20260429 08:00:32.000754 1803 leader_election.cc:304] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters: 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:32.000957 2308 raft_consensus.cc:2804] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:32.001067 2308 raft_consensus.cc:697] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:32.001175 2308 consensus_queue.cc:237] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.002938 1386 catalog_manager.cc:5763] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223) does not have the latest schema for tablet 881e1249f58b4480ad5940e69ee49788 (table default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3]). Expected version 1 got 0
I20260429 08:00:32.003185 1386 catalog_manager.cc:5763] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223) does not have the latest schema for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]). Expected version 1 got 0
I20260429 08:00:32.003275 1386 catalog_manager.cc:5763] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223) does not have the latest schema for tablet 3d4069c79e8f4c36ba414169bd049b8f (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]). Expected version 1 got 0
I20260429 08:00:32.003489 1844 tablet_service.cc:1511] Processing CreateTablet for tablet 29d7fe3ebc3148a9be321460da8abdb5 (DEFAULT_TABLE table=default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.003697 1844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29d7fe3ebc3148a9be321460da8abdb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.004097 1607 catalog_manager.cc:5958] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Sending DeleteTablet for 3 replicas of tablet 974c200acf6b4057a021739a1c7a7ba8
I20260429 08:00:32.005502 2363 tablet_bootstrap.cc:492] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:32.006368 2363 tablet_bootstrap.cc:654] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.007586 1705 tablet_service.cc:1558] Processing DeleteTablet for tablet 974c200acf6b4057a021739a1c7a7ba8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-04-29 08:00:31 UTC) from {username='slave'} at 127.0.0.1:48104
I20260429 08:00:32.007596 1707 tablet_service.cc:1511] Processing CreateTablet for tablet 29d7fe3ebc3148a9be321460da8abdb5 (DEFAULT_TABLE table=default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.007773 2365 tablet_replica.cc:333] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:32.007841 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29d7fe3ebc3148a9be321460da8abdb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.007934 2365 raft_consensus.cc:2243] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:32.008013 2365 raft_consensus.cc:2272] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:32.008431 2365 ts_tablet_manager.cc:1916] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260429 08:00:32.009023 1386 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet c7bc3a1e6a8f4060b9c4132297e04f2f consensus state has no leader
W20260429 08:00:32.009115 1386 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 3d4069c79e8f4c36ba414169bd049b8f (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 3d4069c79e8f4c36ba414169bd049b8f consensus state has no leader
I20260429 08:00:32.009637 2366 tablet_bootstrap.cc:492] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:32.009832 1386 catalog_manager.cc:5763] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279) does not have the latest schema for tablet 3d4069c79e8f4c36ba414169bd049b8f (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]). Expected version 1 got 0
I20260429 08:00:32.010139 2365 ts_tablet_manager.cc:1929] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:32.010193 2365 log.cc:1199] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/974c200acf6b4057a021739a1c7a7ba8
I20260429 08:00:32.010398 2365 ts_tablet_manager.cc:1950] T 974c200acf6b4057a021739a1c7a7ba8 P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:32.010486 2366 tablet_bootstrap.cc:654] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.010932 1386 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34848:
name: "default.Table_f3a21eb41add4d9abf6e559c2a1ebe9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:32.011544 1844 tablet_service.cc:1558] Processing DeleteTablet for tablet 14d1f856aca94369a644ecd753f61af0 with delete_type TABLET_DATA_DELETED (replaced by tablet c7bc3a1e6a8f4060b9c4132297e04f2f) from {username='slave'} at 127.0.0.1:40426
I20260429 08:00:32.011663 2366 tablet_bootstrap.cc:492] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:32.011727 2366 ts_tablet_manager.cc:1403] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:32.011744 1847 tablet_service.cc:1558] Processing DeleteTablet for tablet a9336be80f2442f49cb80c4bb5368318 with delete_type TABLET_DATA_DELETED (replaced by tablet d1ee8252269e41e3bbe96fa3a43d4d9e) from {username='slave'} at 127.0.0.1:40426
I20260429 08:00:32.012005 1844 tablet_service.cc:1558] Processing DeleteTablet for tablet 14b4f7286f694548abafa622ff5d5094 with delete_type TABLET_DATA_DELETED (replaced by tablet e2cfe56e4eca41c0b8ce2f3210f035ea) from {username='slave'} at 127.0.0.1:40426
I20260429 08:00:32.012156 2366 raft_consensus.cc:359] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.012246 2366 raft_consensus.cc:385] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.012279 2366 raft_consensus.cc:740] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.012394 2366 consensus_queue.cc:260] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.012694 2366 ts_tablet_manager.cc:1434] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:32.015085 1380 catalog_manager.cc:5002] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): tablet 974c200acf6b4057a021739a1c7a7ba8 (table default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]) successfully deleted
W20260429 08:00:32.015357 1381 catalog_manager.cc:4969] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): delete failed for tablet 14d1f856aca94369a644ecd753f61af0 because the tablet was not found. No further retry: Not found: Tablet not found: 14d1f856aca94369a644ecd753f61af0
W20260429 08:00:32.015493 1381 catalog_manager.cc:4969] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): delete failed for tablet a9336be80f2442f49cb80c4bb5368318 because the tablet was not found. No further retry: Not found: Tablet not found: a9336be80f2442f49cb80c4bb5368318
W20260429 08:00:32.015625 1381 catalog_manager.cc:4969] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): delete failed for tablet 14b4f7286f694548abafa622ff5d5094 because the tablet was not found. No further retry: Not found: Tablet not found: 14b4f7286f694548abafa622ff5d5094
W20260429 08:00:32.015717 1607 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1ee8252269e41e3bbe96fa3a43d4d9e consensus state has no leader
I20260429 08:00:32.015905 1707 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bed1294b08649efa2f6521e9cefe6b6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d4069c79e8f4c36ba414169bd049b8f) from {username='slave'} at 127.0.0.1:48104
I20260429 08:00:32.016111 1607 catalog_manager.cc:2772] Deleting table default.table_a5c75ef558e9422c9e29eaa5ad3e92ae [id=e109005a4ef9476f8a0fc5021a89f7fb] in response to Hive Metastore notification log event 20
W20260429 08:00:32.018075 1380 catalog_manager.cc:4969] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): delete failed for tablet 6bed1294b08649efa2f6521e9cefe6b6 because the tablet was not found. No further retry: Not found: Tablet not found: 6bed1294b08649efa2f6521e9cefe6b6
I20260429 08:00:32.020699 1985 tablet_service.cc:1558] Processing DeleteTablet for tablet 974c200acf6b4057a021739a1c7a7ba8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-04-29 08:00:31 UTC) from {username='slave'} at 127.0.0.1:51254
I20260429 08:00:32.020921 1845 tablet_service.cc:1558] Processing DeleteTablet for tablet 974c200acf6b4057a021739a1c7a7ba8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-04-29 08:00:31 UTC) from {username='slave'} at 127.0.0.1:40426
I20260429 08:00:32.021064 2362 tablet_replica.cc:333] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:32.021160 2362 raft_consensus.cc:2243] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:32.021322 2362 raft_consensus.cc:2272] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:32.021888 2362 ts_tablet_manager.cc:1916] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:32.021994 1983 tablet_service.cc:1511] Processing CreateTablet for tablet 29d7fe3ebc3148a9be321460da8abdb5 (DEFAULT_TABLE table=default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.022259 1983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29d7fe3ebc3148a9be321460da8abdb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.023784 2362 ts_tablet_manager.cc:1929] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:32.023840 2362 log.cc:1199] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/974c200acf6b4057a021739a1c7a7ba8
I20260429 08:00:32.024096 2362 ts_tablet_manager.cc:1950] T 974c200acf6b4057a021739a1c7a7ba8 P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:32.024330 1846 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a064c4234764686b945a49113a6cdc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 29d7fe3ebc3148a9be321460da8abdb5) from {username='slave'} at 127.0.0.1:40426
I20260429 08:00:32.024847 1381 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet 974c200acf6b4057a021739a1c7a7ba8 (table default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]) successfully deleted
I20260429 08:00:32.025250 1607 catalog_manager.cc:5958] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Sending DeleteTablet for 3 replicas of tablet cd90dd0711a448a18540c23f505ee522
W20260429 08:00:32.026034 1394 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_91fe24cd92b444e1bd97440b6e584816 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260429 08:00:32.027763 1985 tablet_service.cc:1558] Processing DeleteTablet for tablet cd90dd0711a448a18540c23f505ee522 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-04-29 08:00:32 UTC) from {username='slave'} at 127.0.0.1:51254
I20260429 08:00:32.028008 1846 tablet_service.cc:1558] Processing DeleteTablet for tablet cd90dd0711a448a18540c23f505ee522 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-04-29 08:00:32 UTC) from {username='slave'} at 127.0.0.1:40426
I20260429 08:00:32.029151 1707 tablet_service.cc:1558] Processing DeleteTablet for tablet cd90dd0711a448a18540c23f505ee522 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-04-29 08:00:32 UTC) from {username='slave'} at 127.0.0.1:48104
I20260429 08:00:32.029408 2362 tablet_replica.cc:333] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:32.029510 2362 raft_consensus.cc:2243] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:32.029594 2362 raft_consensus.cc:2272] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260429 08:00:32.029958 1381 catalog_manager.cc:4969] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): delete failed for tablet 8a064c4234764686b945a49113a6cdc8 because the tablet was not found. No further retry: Not found: Tablet not found: 8a064c4234764686b945a49113a6cdc8
I20260429 08:00:32.030121 2362 ts_tablet_manager.cc:1916] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:32.032052 2362 ts_tablet_manager.cc:1929] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:32.032121 2362 log.cc:1199] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/cd90dd0711a448a18540c23f505ee522
I20260429 08:00:32.032373 2362 ts_tablet_manager.cc:1950] T cd90dd0711a448a18540c23f505ee522 P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:32.033094 1381 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet cd90dd0711a448a18540c23f505ee522 (table default.table_a5c75ef558e9422c9e29eaa5ad3e92ae [id=e109005a4ef9476f8a0fc5021a89f7fb]) successfully deleted
I20260429 08:00:32.038996 2365 tablet_replica.cc:333] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:32.039167 2365 raft_consensus.cc:2243] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:32.039628 2355 tablet_replica.cc:333] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:32.039755 2355 raft_consensus.cc:2243] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:32.039999 2355 raft_consensus.cc:2272] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:32.040536 2355 ts_tablet_manager.cc:1916] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:32.039988 2365 raft_consensus.cc:2272] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:32.042670 2355 ts_tablet_manager.cc:1929] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:32.042754 2355 log.cc:1199] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/6bed1294b08649efa2f6521e9cefe6b6
I20260429 08:00:32.042901 2365 ts_tablet_manager.cc:1916] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:32.043195 2355 ts_tablet_manager.cc:1950] T 6bed1294b08649efa2f6521e9cefe6b6 P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
W20260429 08:00:32.043277 1382 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet d1ee8252269e41e3bbe96fa3a43d4d9e (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d1ee8252269e41e3bbe96fa3a43d4d9e consensus state has no leader
I20260429 08:00:32.043820 2355 tablet_replica.cc:333] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:32.043931 2355 raft_consensus.cc:2243] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:32.043951 1382 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet 6bed1294b08649efa2f6521e9cefe6b6 (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]) successfully deleted
I20260429 08:00:32.044026 2355 raft_consensus.cc:2272] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:32.044486 2355 ts_tablet_manager.cc:1916] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:32.044713 2359 tablet_bootstrap.cc:492] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:32.044823 2359 ts_tablet_manager.cc:1403] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.120s user 0.002s sys 0.000s
I20260429 08:00:32.045289 2359 raft_consensus.cc:359] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.045432 2359 raft_consensus.cc:385] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.045470 2359 raft_consensus.cc:740] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.045622 2359 consensus_queue.cc:260] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.045977 2359 ts_tablet_manager.cc:1434] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260429 08:00:32.046296 2359 tablet_bootstrap.cc:492] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:32.047015 2355 ts_tablet_manager.cc:1929] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:32.047215 2355 log.cc:1199] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/14d1f856aca94369a644ecd753f61af0
I20260429 08:00:32.047327 2359 tablet_bootstrap.cc:654] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.047600 2355 ts_tablet_manager.cc:1950] T 14d1f856aca94369a644ecd753f61af0 P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:32.048312 1382 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet 14d1f856aca94369a644ecd753f61af0 (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]) successfully deleted
I20260429 08:00:32.048679 2355 tablet_replica.cc:333] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:32.049233 2355 raft_consensus.cc:2243] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:32.049393 2355 raft_consensus.cc:2272] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:32.050493 2355 ts_tablet_manager.cc:1916] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:32.052053 1462 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=76db81fc69b8490d98c0496a830d00c2]
I20260429 08:00:32.052327 1462 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58408 (request call id 50) took 1652 ms. Trace:
I20260429 08:00:32.052371 1462 rpcz_store.cc:276] 0429 08:00:30.400335 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:30.514738 (+114403us) service_pool.cc:225] Handling call
0429 08:00:31.046750 (+532012us) catalog_manager.cc:2101] Acquired catalog manager lock
0429 08:00:31.047160 (+ 410us) catalog_manager.cc:2147] Created new table and tablet info
0429 08:00:31.697115 (+649955us) catalog_manager.cc:2173] Created new table in HMS catalog
0429 08:00:31.697649 (+ 534us) write_op.cc:489] Releasing partition, row and schema locks
0429 08:00:31.697651 (+ 2us) write_op.cc:454] Released schema lock
0429 08:00:31.697779 (+ 128us) catalog_manager.cc:2181] Rolling back HMS table creation
0429 08:00:32.052316 (+354537us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0429 08:00:31.697593 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica f1e6af049ae04c6e98cb5e609f9be472 is not leader of this config: current role FOLLOWER)
0429 08:00:31.697603 (+ 10us) write_op.cc:489] Releasing partition, row and schema locks
0429 08:00:31.697607 (+ 4us) write_op.cc:454] Released schema lock
0429 08:00:31.697610 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":773619,"Hive Metastore.run_cpu_time_us":397,"Hive Metastore.run_wall_time_us":230359,"child_traces":[["op",{}]]}
I20260429 08:00:32.057221 2359 tablet_bootstrap.cc:492] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:32.057343 2359 ts_tablet_manager.cc:1403] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20260429 08:00:32.057868 2260 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:32.057971 2260 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.058104 2365 ts_tablet_manager.cc:1929] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:32.058185 2365 log.cc:1199] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/cd90dd0711a448a18540c23f505ee522
I20260429 08:00:32.058385 2260 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.058446 2365 ts_tablet_manager.cc:1950] T cd90dd0711a448a18540c23f505ee522 P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:32.059002 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29d7fe3ebc3148a9be321460da8abdb5" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:32.059489 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29d7fe3ebc3148a9be321460da8abdb5" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:32.059777 1380 catalog_manager.cc:5002] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): tablet cd90dd0711a448a18540c23f505ee522 (table default.table_a5c75ef558e9422c9e29eaa5ad3e92ae [id=e109005a4ef9476f8a0fc5021a89f7fb]) successfully deleted
W20260429 08:00:32.059973 1667 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Illegal state: must be running to vote when last-logged opid is not known
W20260429 08:00:32.060277 1666 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Illegal state: must be running to vote when last-logged opid is not known
I20260429 08:00:32.060352 1666 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6441a846e67a46159cef1413b6d06337; no voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:32.060637 2260 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260429 08:00:32.060981 2359 raft_consensus.cc:359] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.061087 2359 raft_consensus.cc:385] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.061125 2359 raft_consensus.cc:740] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.061261 2359 consensus_queue.cc:260] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.063310 2359 ts_tablet_manager.cc:1434] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260429 08:00:32.065047 2359 tablet_bootstrap.cc:492] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:32.066222 2359 tablet_bootstrap.cc:654] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.067229 2355 ts_tablet_manager.cc:1929] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:32.067308 2355 log.cc:1199] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/a9336be80f2442f49cb80c4bb5368318
I20260429 08:00:32.067560 2355 ts_tablet_manager.cc:1950] T a9336be80f2442f49cb80c4bb5368318 P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:32.073154 1382 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet a9336be80f2442f49cb80c4bb5368318 (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]) successfully deleted
I20260429 08:00:32.073392 2355 tablet_replica.cc:333] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:32.073518 2355 raft_consensus.cc:2243] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:32.073621 2355 raft_consensus.cc:2272] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:32.074227 2359 tablet_bootstrap.cc:492] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:32.074311 2359 ts_tablet_manager.cc:1403] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20260429 08:00:32.074663 2359 raft_consensus.cc:359] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.074760 2359 raft_consensus.cc:385] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.074785 2359 raft_consensus.cc:740] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.074812 2363 tablet_bootstrap.cc:492] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:32.074908 2359 consensus_queue.cc:260] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.074941 2363 ts_tablet_manager.cc:1403] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.069s user 0.000s sys 0.002s
I20260429 08:00:32.075117 2359 ts_tablet_manager.cc:1434] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:32.075379 2363 raft_consensus.cc:359] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.075505 2363 raft_consensus.cc:385] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.075546 2363 raft_consensus.cc:740] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.075663 2363 consensus_queue.cc:260] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.075929 2363 ts_tablet_manager.cc:1434] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260429 08:00:32.077193 2359 tablet_bootstrap.cc:492] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:32.077765 2260 raft_consensus.cc:493] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:32.077869 2260 raft_consensus.cc:515] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.078215 2260 leader_election.cc:290] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.079085 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bc3a1e6a8f4060b9c4132297e04f2f" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:32.079211 1867 raft_consensus.cc:2468] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:32.079681 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bc3a1e6a8f4060b9c4132297e04f2f" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:32.079814 2004 raft_consensus.cc:2468] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:32.079981 2359 tablet_bootstrap.cc:654] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.080132 2337 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:32.080224 2337 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.080617 2337 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.080706 2337 raft_consensus.cc:493] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:32.074214 2355 ts_tablet_manager.cc:1916] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:32.080770 2337 raft_consensus.cc:515] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.081072 2337 leader_election.cc:290] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.081815 1868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2cfe56e4eca41c0b8ce2f3210f035ea" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:32.082113 2230 raft_consensus.cc:493] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:32.081943 1868 raft_consensus.cc:2468] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:32.082186 2230 raft_consensus.cc:515] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.082335 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2cfe56e4eca41c0b8ce2f3210f035ea" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:32.082443 2005 raft_consensus.cc:2468] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:32.082496 2230 leader_election.cc:290] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:32.083288 1667 leader_election.cc:304] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:32.083324 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee8252269e41e3bbe96fa3a43d4d9e" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:32.083420 1394 catalog_manager.cc:2174] created HMS catalog entry for table [id=85f2230320084f08a7b147f7efd77ed1]
I20260429 08:00:32.083455 1729 raft_consensus.cc:2393] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 873f2b4fab6f42738b2d41b4608a592a in current term 1: Already voted for candidate 353e59f343974ee68738535fb9029d30 in this term.
I20260429 08:00:32.083489 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4069c79e8f4c36ba414169bd049b8f" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:32.083614 2004 raft_consensus.cc:2393] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6441a846e67a46159cef1413b6d06337 in current term 1: Already voted for candidate 353e59f343974ee68738535fb9029d30 in this term.
I20260429 08:00:32.083784 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d4069c79e8f4c36ba414169bd049b8f" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:32.087108 1666 leader_election.cc:304] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:32.087316 2260 raft_consensus.cc:2804] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:32.087370 2260 raft_consensus.cc:493] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:32.087414 2260 raft_consensus.cc:3060] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.087535 2355 ts_tablet_manager.cc:1929] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:32.087637 2355 log.cc:1199] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/14b4f7286f694548abafa622ff5d5094
I20260429 08:00:32.087929 2355 ts_tablet_manager.cc:1950] T 14b4f7286f694548abafa622ff5d5094 P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:32.088050 1394 catalog_manager.cc:5763] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803) does not have the latest schema for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]). Expected version 1 got 0
I20260429 08:00:32.088203 1394 catalog_manager.cc:5763] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803) does not have the latest schema for tablet 3d4069c79e8f4c36ba414169bd049b8f (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]). Expected version 1 got 0
I20260429 08:00:32.088279 1394 catalog_manager.cc:5763] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803) does not have the latest schema for tablet d1ee8252269e41e3bbe96fa3a43d4d9e (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]). Expected version 1 got 0
I20260429 08:00:32.088397 2260 raft_consensus.cc:515] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.088454 2355 tablet_replica.cc:333] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:32.088548 2355 raft_consensus.cc:2243] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:32.088653 2355 raft_consensus.cc:2272] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:32.088743 2260 leader_election.cc:290] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Requested vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.088840 2260 raft_consensus.cc:2804] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:32.088876 2260 raft_consensus.cc:493] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:32.088907 2260 raft_consensus.cc:3060] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.089123 2355 ts_tablet_manager.cc:1916] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:32.089676 2260 raft_consensus.cc:515] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.089978 2260 leader_election.cc:290] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Requested vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.090116 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ee8252269e41e3bbe96fa3a43d4d9e" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:32.090456 1939 leader_election.cc:304] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:32.090597 2230 raft_consensus.cc:3060] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.091028 1382 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet 14b4f7286f694548abafa622ff5d5094 (table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]) successfully deleted
I20260429 08:00:32.091256 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2cfe56e4eca41c0b8ce2f3210f035ea" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:32.091361 2005 raft_consensus.cc:3060] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.091379 2230 raft_consensus.cc:2749] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260429 08:00:32.091615 2355 ts_tablet_manager.cc:1929] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:32.091658 2355 log.cc:1199] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/8a064c4234764686b945a49113a6cdc8
I20260429 08:00:32.091876 2355 ts_tablet_manager.cc:1950] T 8a064c4234764686b945a49113a6cdc8 P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:32.092119 1667 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6441a846e67a46159cef1413b6d06337; no voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:32.092219 2005 raft_consensus.cc:2468] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:32.092344 2355 tablet_replica.cc:333] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:32.092453 2355 raft_consensus.cc:2243] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:32.092542 2355 raft_consensus.cc:2272] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:32.092687 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bc3a1e6a8f4060b9c4132297e04f2f" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:32.092796 2004 raft_consensus.cc:3060] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.093725 2004 raft_consensus.cc:2468] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:32.094655 1868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2cfe56e4eca41c0b8ce2f3210f035ea" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:32.094749 1868 raft_consensus.cc:3060] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.095638 1868 raft_consensus.cc:2468] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:32.095880 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bc3a1e6a8f4060b9c4132297e04f2f" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:32.095966 1867 raft_consensus.cc:3060] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.096779 1867 raft_consensus.cc:2468] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:32.097191 1666 leader_election.cc:304] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:32.097322 2229 raft_consensus.cc:3060] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.097352 1666 leader_election.cc:304] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:32.097609 2337 raft_consensus.cc:2804] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:32.097738 2337 raft_consensus.cc:697] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Becoming Leader. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Running, Role: LEADER
I20260429 08:00:32.097874 2337 consensus_queue.cc:237] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.098114 2229 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260429 08:00:32.098194 2229 raft_consensus.cc:2804] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:32.098241 2229 raft_consensus.cc:697] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Becoming Leader. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Running, Role: LEADER
I20260429 08:00:32.098322 2229 consensus_queue.cc:237] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.100275 2355 ts_tablet_manager.cc:1916] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:32.100744 1382 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet 8a064c4234764686b945a49113a6cdc8 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]) successfully deleted
I20260429 08:00:32.101166 2359 tablet_bootstrap.cc:492] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:32.101267 2359 ts_tablet_manager.cc:1403] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.001s
I20260429 08:00:32.101774 2359 raft_consensus.cc:359] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.101903 2359 raft_consensus.cc:385] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.101943 2359 raft_consensus.cc:740] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.101989 1707 tablet_service.cc:1511] Processing CreateTablet for tablet 3b29c11f78624a22922bae3070f194f3 (DEFAULT_TABLE table=default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.102053 2359 consensus_queue.cc:260] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.102034 1846 tablet_service.cc:1511] Processing CreateTablet for tablet 3b29c11f78624a22922bae3070f194f3 (DEFAULT_TABLE table=default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.102262 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b29c11f78624a22922bae3070f194f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.102300 1846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b29c11f78624a22922bae3070f194f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.102351 2359 ts_tablet_manager.cc:1434] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260429 08:00:32.104053 2366 tablet_bootstrap.cc:492] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:32.104991 2363 tablet_bootstrap.cc:492] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:32.105255 2366 tablet_bootstrap.cc:654] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.105566 2355 ts_tablet_manager.cc:1929] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:32.105625 2355 log.cc:1199] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/974c200acf6b4057a021739a1c7a7ba8
I20260429 08:00:32.105882 2355 ts_tablet_manager.cc:1950] T 974c200acf6b4057a021739a1c7a7ba8 P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:32.106030 2363 tablet_bootstrap.cc:654] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.106552 2355 tablet_replica.cc:333] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:32.106667 2355 raft_consensus.cc:2243] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:32.106848 2355 raft_consensus.cc:2272] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:32.107136 1382 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet 974c200acf6b4057a021739a1c7a7ba8 (table default.table_a7449fdac83e405daed3c36aecdd0b32 [id=f9917ae2527843028b7d5d42c72bb753]) successfully deleted
I20260429 08:00:32.107430 1983 tablet_service.cc:1511] Processing CreateTablet for tablet 3b29c11f78624a22922bae3070f194f3 (DEFAULT_TABLE table=default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.107652 1983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b29c11f78624a22922bae3070f194f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.107911 1394 catalog_manager.cc:6216] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3] alter complete (version 1)
I20260429 08:00:32.109095 1394 catalog_manager.cc:5671] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 353e59f343974ee68738535fb9029d30 (127.1.14.2). New cstate: current_term: 1 leader_uuid: "353e59f343974ee68738535fb9029d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:32.109403 2359 tablet_bootstrap.cc:492] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:32.109685 1394 catalog_manager.cc:5763] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223) does not have the latest schema for tablet 3d4069c79e8f4c36ba414169bd049b8f (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]). Expected version 1 got 0
I20260429 08:00:32.110297 2359 tablet_bootstrap.cc:654] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.110713 1394 catalog_manager.cc:5671] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 353e59f343974ee68738535fb9029d30 (127.1.14.2). New cstate: current_term: 1 leader_uuid: "353e59f343974ee68738535fb9029d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:32.110922 1394 catalog_manager.cc:5763] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223) does not have the latest schema for tablet d1ee8252269e41e3bbe96fa3a43d4d9e (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]). Expected version 1 got 0
I20260429 08:00:32.111042 1394 catalog_manager.cc:5763] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223) does not have the latest schema for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]). Expected version 1 got 0
I20260429 08:00:32.107430 2355 ts_tablet_manager.cc:1916] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:32.112776 2355 ts_tablet_manager.cc:1929] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:32.112846 2355 log.cc:1199] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/cd90dd0711a448a18540c23f505ee522
I20260429 08:00:32.113057 2355 ts_tablet_manager.cc:1950] T cd90dd0711a448a18540c23f505ee522 P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:32.113677 2363 tablet_bootstrap.cc:492] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:32.113762 2363 ts_tablet_manager.cc:1403] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260429 08:00:32.114192 2363 raft_consensus.cc:359] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.114292 2363 raft_consensus.cc:385] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.114328 2363 raft_consensus.cc:740] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.114451 2363 consensus_queue.cc:260] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.114724 2363 ts_tablet_manager.cc:1434] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260429 08:00:32.116532 1382 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet cd90dd0711a448a18540c23f505ee522 (table default.table_a5c75ef558e9422c9e29eaa5ad3e92ae [id=e109005a4ef9476f8a0fc5021a89f7fb]) successfully deleted
I20260429 08:00:32.118726 2359 tablet_bootstrap.cc:492] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:32.118826 2359 ts_tablet_manager.cc:1403] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20260429 08:00:32.119215 2359 raft_consensus.cc:359] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.119311 2359 raft_consensus.cc:385] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.119346 2359 raft_consensus.cc:740] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.119458 2359 consensus_queue.cc:260] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.119701 2359 ts_tablet_manager.cc:1434] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260429 08:00:32.119694 1846 tablet_service.cc:1558] Processing DeleteTablet for tablet 974c200acf6b4057a021739a1c7a7ba8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-04-29 08:00:31 UTC) from {username='slave'} at 127.0.0.1:40426
I20260429 08:00:32.119838 1983 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a064c4234764686b945a49113a6cdc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 29d7fe3ebc3148a9be321460da8abdb5) from {username='slave'} at 127.0.0.1:51254
W20260429 08:00:32.120033 1381 catalog_manager.cc:4969] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): delete failed for tablet 974c200acf6b4057a021739a1c7a7ba8 because the tablet was not found. No further retry: Not found: Tablet not found: 974c200acf6b4057a021739a1c7a7ba8
I20260429 08:00:32.120870 1394 catalog_manager.cc:5671] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6441a846e67a46159cef1413b6d06337 (127.1.14.1). New cstate: current_term: 1 leader_uuid: "6441a846e67a46159cef1413b6d06337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
W20260429 08:00:32.121085 1382 catalog_manager.cc:4969] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): delete failed for tablet 8a064c4234764686b945a49113a6cdc8 because the tablet was not found. No further retry: Not found: Tablet not found: 8a064c4234764686b945a49113a6cdc8
I20260429 08:00:32.121232 1394 catalog_manager.cc:5763] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803) does not have the latest schema for tablet 29d7fe3ebc3148a9be321460da8abdb5 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]). Expected version 1 got 0
I20260429 08:00:32.121385 1394 catalog_manager.cc:5671] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6441a846e67a46159cef1413b6d06337 (127.1.14.1). New cstate: current_term: 1 leader_uuid: "6441a846e67a46159cef1413b6d06337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:32.121608 1394 catalog_manager.cc:5763] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803) does not have the latest schema for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]). Expected version 1 got 0
W20260429 08:00:32.124445 1392 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_3b6223798dcd434c989986f1d5727b55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:32.125115 1388 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c566aa86e5284b17bb9bf76547b211f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:32.125823 1390 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9f5b102f2ff746f39f84bc047bfb16c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:32.126521 1387 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_09d20647c80a4575b1d220f120d4c58a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260429 08:00:32.127353 1386 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f3a21eb41add4d9abf6e559c2a1ebe9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260429 08:00:32.128942 2366 tablet_bootstrap.cc:492] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:32.129037 2366 ts_tablet_manager.cc:1403] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.002s
I20260429 08:00:32.129473 2366 raft_consensus.cc:359] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.129568 2366 raft_consensus.cc:385] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.129599 2366 raft_consensus.cc:740] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.129740 2366 consensus_queue.cc:260] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.130018 2366 ts_tablet_manager.cc:1434] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20260429 08:00:32.136270 1394 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 29d7fe3ebc3148a9be321460da8abdb5 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 29d7fe3ebc3148a9be321460da8abdb5 consensus state has no leader
I20260429 08:00:32.137421 1394 catalog_manager.cc:5763] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223) does not have the latest schema for tablet 29d7fe3ebc3148a9be321460da8abdb5 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]). Expected version 1 got 0
I20260429 08:00:32.138711 1394 catalog_manager.cc:5763] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279) does not have the latest schema for tablet 29d7fe3ebc3148a9be321460da8abdb5 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]). Expected version 1 got 0
I20260429 08:00:32.138868 1394 catalog_manager.cc:5763] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279) does not have the latest schema for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]). Expected version 1 got 0
I20260429 08:00:32.139026 1394 catalog_manager.cc:5763] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279) does not have the latest schema for tablet d1ee8252269e41e3bbe96fa3a43d4d9e (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]). Expected version 1 got 0
I20260429 08:00:32.140875 1394 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34848:
name: "default.Table_b1938a0ba6d9429ba63271d6f958a060"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:32.166260 1458 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=038ee5f1404b4d3ca452c21bfa0253e6]
I20260429 08:00:32.166503 1458 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58408 (request call id 52) took 1709 ms. Trace:
I20260429 08:00:32.166556 1458 rpcz_store.cc:276] 0429 08:00:30.456808 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:30.599898 (+143090us) service_pool.cc:225] Handling call
0429 08:00:31.046887 (+446989us) catalog_manager.cc:2101] Acquired catalog manager lock
0429 08:00:31.047191 (+ 304us) catalog_manager.cc:2147] Created new table and tablet info
0429 08:00:31.728051 (+680860us) catalog_manager.cc:2173] Created new table in HMS catalog
0429 08:00:31.728438 (+ 387us) write_op.cc:489] Releasing partition, row and schema locks
0429 08:00:31.728439 (+ 1us) write_op.cc:454] Released schema lock
0429 08:00:31.728516 (+ 77us) catalog_manager.cc:2181] Rolling back HMS table creation
0429 08:00:32.166489 (+437973us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0429 08:00:31.728401 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica f1e6af049ae04c6e98cb5e609f9be472 is not leader of this config: current role FOLLOWER)
0429 08:00:31.728406 (+ 5us) write_op.cc:489] Releasing partition, row and schema locks
0429 08:00:31.728409 (+ 3us) write_op.cc:454] Released schema lock
0429 08:00:31.728411 (+ 2us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":973306,"Hive Metastore.run_cpu_time_us":383,"Hive Metastore.run_wall_time_us":145109,"child_traces":[["op",{}]]}
I20260429 08:00:32.176754 1393 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]
I20260429 08:00:32.196636 2004 raft_consensus.cc:1275] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Refusing update from remote peer 353e59f343974ee68738535fb9029d30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260429 08:00:32.197140 2238 consensus_queue.cc:1048] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.197916 1729 raft_consensus.cc:1275] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Refusing update from remote peer 353e59f343974ee68738535fb9029d30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260429 08:00:32.198627 1392 catalog_manager.cc:2174] created HMS catalog entry for table [id=e3686089ce534efaaa9cc84eb588a4d5]
I20260429 08:00:32.198622 2238 consensus_queue.cc:1048] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.201478 2005 raft_consensus.cc:1275] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Refusing update from remote peer 6441a846e67a46159cef1413b6d06337: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260429 08:00:32.202294 1867 raft_consensus.cc:1275] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Refusing update from remote peer 6441a846e67a46159cef1413b6d06337: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260429 08:00:32.202936 2260 consensus_queue.cc:1048] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.204254 2260 consensus_queue.cc:1048] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.208940 2351 tablet.cc:1724] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:32.210317 1392 catalog_manager.cc:5763] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279) does not have the latest schema for tablet d1ee8252269e41e3bbe96fa3a43d4d9e (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]). Expected version 1 got 0
I20260429 08:00:32.211089 1392 catalog_manager.cc:5763] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803) does not have the latest schema for tablet d1ee8252269e41e3bbe96fa3a43d4d9e (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]). Expected version 1 got 0
I20260429 08:00:32.211352 2305 mvcc.cc:204] Tried to move back new op lower bound from 7280433693471559680 to 7280433692678348800. Current Snapshot: MvccSnapshot[applied={T|T < 7280433693471559680}]
I20260429 08:00:32.211898 1392 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_a3cf45aaf37c4ddf9ed00173d7c72a4c" } modify_external_catalogs: true
I20260429 08:00:32.212020 1392 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_a3cf45aaf37c4ddf9ed00173d7c72a4c" } modify_external_catalogs: true
I20260429 08:00:32.212121 2307 mvcc.cc:204] Tried to move back new op lower bound from 7280433693471559680 to 7280433692678348800. Current Snapshot: MvccSnapshot[applied={T|T < 7280433693471559680}]
I20260429 08:00:32.212327 2352 tablet.cc:1724] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:32.215781 2293 mvcc.cc:204] Tried to move back new op lower bound from 7280433693471559680 to 7280433692678348800. Current Snapshot: MvccSnapshot[applied={T|T < 7280433693471559680}]
I20260429 08:00:32.216004 2350 tablet.cc:1724] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:32.220647 2350 tablet.cc:1724] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:32.221652 2352 tablet.cc:1724] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:32.225716 2004 raft_consensus.cc:1275] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Refusing update from remote peer 353e59f343974ee68738535fb9029d30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260429 08:00:32.226313 2232 consensus_queue.cc:1048] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.227589 1729 raft_consensus.cc:1275] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Refusing update from remote peer 353e59f343974ee68738535fb9029d30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260429 08:00:32.228124 2309 consensus_queue.cc:1048] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.231688 1983 tablet_service.cc:1511] Processing CreateTablet for tablet 5a2349526fb740f4b9c964cb9ecef4d6 (DEFAULT_TABLE table=default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.232170 1707 tablet_service.cc:1511] Processing CreateTablet for tablet 5a2349526fb740f4b9c964cb9ecef4d6 (DEFAULT_TABLE table=default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.232414 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a2349526fb740f4b9c964cb9ecef4d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.232762 1983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a2349526fb740f4b9c964cb9ecef4d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.234218 2366 tablet_bootstrap.cc:492] T 5a2349526fb740f4b9c964cb9ecef4d6 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:32.234839 2359 tablet_bootstrap.cc:492] T 5a2349526fb740f4b9c964cb9ecef4d6 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:32.235173 2366 tablet_bootstrap.cc:654] T 5a2349526fb740f4b9c964cb9ecef4d6 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.235641 2359 tablet_bootstrap.cc:654] T 5a2349526fb740f4b9c964cb9ecef4d6 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.235875 2351 tablet.cc:1724] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:32.236847 1846 tablet_service.cc:1511] Processing CreateTablet for tablet 5a2349526fb740f4b9c964cb9ecef4d6 (DEFAULT_TABLE table=default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.237102 1846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a2349526fb740f4b9c964cb9ecef4d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.238960 2363 tablet_bootstrap.cc:492] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:32.239890 2363 tablet_bootstrap.cc:654] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.240161 2366 tablet_bootstrap.cc:492] T 5a2349526fb740f4b9c964cb9ecef4d6 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:32.240244 2366 ts_tablet_manager.cc:1403] T 5a2349526fb740f4b9c964cb9ecef4d6 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260429 08:00:32.240537 2351 tablet.cc:1724] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:32.240702 2366 raft_consensus.cc:359] T 5a2349526fb740f4b9c964cb9ecef4d6 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.240789 2366 raft_consensus.cc:385] T 5a2349526fb740f4b9c964cb9ecef4d6 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.240818 2366 raft_consensus.cc:740] T 5a2349526fb740f4b9c964cb9ecef4d6 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.240841 2363 tablet_bootstrap.cc:492] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:32.240902 2363 ts_tablet_manager.cc:1403] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260429 08:00:32.240918 2366 consensus_queue.cc:260] T 5a2349526fb740f4b9c964cb9ecef4d6 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.241185 2366 ts_tablet_manager.cc:1434] T 5a2349526fb740f4b9c964cb9ecef4d6 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:32.241312 2363 raft_consensus.cc:359] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.241422 2363 raft_consensus.cc:385] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.241462 2363 raft_consensus.cc:740] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.241571 2363 consensus_queue.cc:260] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.241822 2363 ts_tablet_manager.cc:1434] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260429 08:00:32.245572 2352 tablet.cc:1724] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:32.248003 2359 tablet_bootstrap.cc:492] T 5a2349526fb740f4b9c964cb9ecef4d6 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:32.248097 2359 ts_tablet_manager.cc:1403] T 5a2349526fb740f4b9c964cb9ecef4d6 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20260429 08:00:32.248500 2359 raft_consensus.cc:359] T 5a2349526fb740f4b9c964cb9ecef4d6 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.248605 2359 raft_consensus.cc:385] T 5a2349526fb740f4b9c964cb9ecef4d6 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.248636 2359 raft_consensus.cc:740] T 5a2349526fb740f4b9c964cb9ecef4d6 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.248742 2359 consensus_queue.cc:260] T 5a2349526fb740f4b9c964cb9ecef4d6 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.248991 2359 ts_tablet_manager.cc:1434] T 5a2349526fb740f4b9c964cb9ecef4d6 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260429 08:00:32.251991 1388 catalog_manager.cc:2174] created HMS catalog entry for table [id=77e01a7bd9df443390b71b28cd2ad156]
I20260429 08:00:32.256546 1388 catalog_manager.cc:5763] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223) does not have the latest schema for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]). Expected version 1 got 0
I20260429 08:00:32.257578 1388 catalog_manager.cc:5763] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803) does not have the latest schema for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]). Expected version 1 got 0
I20260429 08:00:32.258311 1465 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=4e473de5605545c8a22a1060cedb39cf]
I20260429 08:00:32.258486 1465 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58408 (request call id 47) took 1906 ms. Trace:
I20260429 08:00:32.258527 1465 rpcz_store.cc:276] 0429 08:00:30.351924 (+ 0us) service_pool.cc:168] Inserting onto call queue
0429 08:00:30.359493 (+ 7569us) service_pool.cc:225] Handling call
0429 08:00:31.047174 (+687681us) catalog_manager.cc:2101] Acquired catalog manager lock
0429 08:00:31.047492 (+ 318us) catalog_manager.cc:2147] Created new table and tablet info
0429 08:00:31.813128 (+765636us) catalog_manager.cc:2173] Created new table in HMS catalog
0429 08:00:31.813654 (+ 526us) write_op.cc:489] Releasing partition, row and schema locks
0429 08:00:31.813655 (+ 1us) write_op.cc:454] Released schema lock
0429 08:00:31.813775 (+ 120us) catalog_manager.cc:2181] Rolling back HMS table creation
0429 08:00:32.258474 (+444699us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0429 08:00:31.813605 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica f1e6af049ae04c6e98cb5e609f9be472 is not leader of this config: current role FOLLOWER)
0429 08:00:31.813614 (+ 9us) write_op.cc:489] Releasing partition, row and schema locks
0429 08:00:31.813618 (+ 4us) write_op.cc:454] Released schema lock
0429 08:00:31.813621 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1091384,"Hive Metastore.run_cpu_time_us":351,"Hive Metastore.run_wall_time_us":118412,"child_traces":[["op",{}]]}
I20260429 08:00:32.267977 2393 tablet.cc:1724] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260429 08:00:32.270344 1388 catalog_manager.cc:6216] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2] alter complete (version 1)
I20260429 08:00:32.270769 1846 tablet_service.cc:1511] Processing CreateTablet for tablet c1c2987616df4a438b5160e1fbc5387e (DEFAULT_TABLE table=default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.271052 1846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c2987616df4a438b5160e1fbc5387e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.271090 1388 catalog_manager.cc:5763] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279) does not have the latest schema for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]). Expected version 1 got 0
I20260429 08:00:32.273288 1707 tablet_service.cc:1511] Processing CreateTablet for tablet c1c2987616df4a438b5160e1fbc5387e (DEFAULT_TABLE table=default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.273533 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c2987616df4a438b5160e1fbc5387e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.273814 1983 tablet_service.cc:1511] Processing CreateTablet for tablet c1c2987616df4a438b5160e1fbc5387e (DEFAULT_TABLE table=default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.274086 1983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c2987616df4a438b5160e1fbc5387e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.275327 2366 tablet_bootstrap.cc:492] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:32.275774 2359 tablet_bootstrap.cc:492] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:32.276230 2366 tablet_bootstrap.cc:654] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.276643 2359 tablet_bootstrap.cc:654] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.277987 2363 tablet_bootstrap.cc:492] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:32.278851 2363 tablet_bootstrap.cc:654] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.281067 2359 tablet_bootstrap.cc:492] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:32.281155 2359 ts_tablet_manager.cc:1403] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260429 08:00:32.281651 2359 raft_consensus.cc:359] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.281764 2359 raft_consensus.cc:385] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.281795 2359 raft_consensus.cc:740] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.281922 2359 consensus_queue.cc:260] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.282200 2359 ts_tablet_manager.cc:1434] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260429 08:00:32.282994 2363 tablet_bootstrap.cc:492] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:32.283087 2363 ts_tablet_manager.cc:1403] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260429 08:00:32.283294 2366 tablet_bootstrap.cc:492] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:32.283375 2366 ts_tablet_manager.cc:1403] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260429 08:00:32.283519 2363 raft_consensus.cc:359] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.283613 2363 raft_consensus.cc:385] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.283643 2363 raft_consensus.cc:740] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.283753 2363 consensus_queue.cc:260] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.283751 2366 raft_consensus.cc:359] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.283869 2366 raft_consensus.cc:385] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.283898 2366 raft_consensus.cc:740] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.283991 2366 consensus_queue.cc:260] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.284011 2363 ts_tablet_manager.cc:1434] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260429 08:00:32.286829 2366 ts_tablet_manager.cc:1434] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260429 08:00:32.287396 1388 catalog_manager.cc:6216] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91] alter complete (version 1)
I20260429 08:00:32.294414 1388 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_03bb29fc9f854e85b7fc52f6523c6db0" } modify_external_catalogs: true
I20260429 08:00:32.294625 1388 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_03bb29fc9f854e85b7fc52f6523c6db0" } modify_external_catalogs: true
I20260429 08:00:32.305200 2309 raft_consensus.cc:493] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:32.305289 2309 raft_consensus.cc:515] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.305656 2309 leader_election.cc:290] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.306423 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2349526fb740f4b9c964cb9ecef4d6" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:32.306545 1729 raft_consensus.cc:2468] T 5a2349526fb740f4b9c964cb9ecef4d6 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:32.306954 1803 leader_election.cc:304] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:32.307161 2309 raft_consensus.cc:2804] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:32.307214 2309 raft_consensus.cc:493] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:32.307255 2309 raft_consensus.cc:3060] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.307947 2309 raft_consensus.cc:515] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.308256 2309 leader_election.cc:290] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.308420 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2349526fb740f4b9c964cb9ecef4d6" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:32.308492 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2349526fb740f4b9c964cb9ecef4d6" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:32.308532 2004 raft_consensus.cc:2468] T 5a2349526fb740f4b9c964cb9ecef4d6 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:32.308589 1729 raft_consensus.cc:3060] T 5a2349526fb740f4b9c964cb9ecef4d6 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.308750 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a2349526fb740f4b9c964cb9ecef4d6" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:32.308838 2005 raft_consensus.cc:3060] T 5a2349526fb740f4b9c964cb9ecef4d6 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.309489 1729 raft_consensus.cc:2468] T 5a2349526fb740f4b9c964cb9ecef4d6 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:32.309659 2005 raft_consensus.cc:2468] T 5a2349526fb740f4b9c964cb9ecef4d6 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:32.309856 1803 leader_election.cc:304] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:32.310010 2309 raft_consensus.cc:2804] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:32.310096 2309 raft_consensus.cc:697] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:32.310216 2309 consensus_queue.cc:237] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.311415 1391 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]
I20260429 08:00:32.322845 1080 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task0BSNFf/build/debug/bin/kudu with pid 2109
I20260429 08:00:32.333418 1390 catalog_manager.cc:2174] created HMS catalog entry for table [id=d6ea842bf09f48afa629edccff01e16b]
W20260429 08:00:32.335318 1382 connection.cc:570] client connection to 127.1.14.60:41737 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:32.338176 1382 consensus_peers.cc:597] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 -> Peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Couldn't send request to peer cd076a6196ef424a813003c9c5d53d42. Status: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260429 08:00:32.342765 1390 catalog_manager.cc:5671] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 353e59f343974ee68738535fb9029d30 (127.1.14.2). New cstate: current_term: 1 leader_uuid: "353e59f343974ee68738535fb9029d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:32.343786 1707 tablet_service.cc:1511] Processing CreateTablet for tablet 43def4d831db44c09e060f4949e6f8ac (DEFAULT_TABLE table=default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.343880 1846 tablet_service.cc:1511] Processing CreateTablet for tablet 43def4d831db44c09e060f4949e6f8ac (DEFAULT_TABLE table=default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.344067 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43def4d831db44c09e060f4949e6f8ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.344165 1846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43def4d831db44c09e060f4949e6f8ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.346115 2366 tablet_bootstrap.cc:492] T 43def4d831db44c09e060f4949e6f8ac P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:32.347194 2366 tablet_bootstrap.cc:654] T 43def4d831db44c09e060f4949e6f8ac P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.347828 2363 tablet_bootstrap.cc:492] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:32.348851 1983 tablet_service.cc:1511] Processing CreateTablet for tablet 43def4d831db44c09e060f4949e6f8ac (DEFAULT_TABLE table=default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.349118 1983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43def4d831db44c09e060f4949e6f8ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.350410 1390 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_6795420cac01458198a3bf0876fd6092" } new_table_name: "default.Table_7d633f7b157e487daf0b0a993a8a71bc" modify_external_catalogs: true
I20260429 08:00:32.351087 2359 tablet_bootstrap.cc:492] T 43def4d831db44c09e060f4949e6f8ac P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:32.352183 2359 tablet_bootstrap.cc:654] T 43def4d831db44c09e060f4949e6f8ac P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.352893 2363 tablet_bootstrap.cc:654] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.353250 2359 tablet_bootstrap.cc:492] T 43def4d831db44c09e060f4949e6f8ac P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:32.353314 2359 ts_tablet_manager.cc:1403] T 43def4d831db44c09e060f4949e6f8ac P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260429 08:00:32.353698 2359 raft_consensus.cc:359] T 43def4d831db44c09e060f4949e6f8ac P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.353828 2359 raft_consensus.cc:385] T 43def4d831db44c09e060f4949e6f8ac P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.353873 2359 raft_consensus.cc:740] T 43def4d831db44c09e060f4949e6f8ac P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.353994 2359 consensus_queue.cc:260] T 43def4d831db44c09e060f4949e6f8ac P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.354279 2359 ts_tablet_manager.cc:1434] T 43def4d831db44c09e060f4949e6f8ac P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:32.354876 2363 tablet_bootstrap.cc:492] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:32.354941 2363 ts_tablet_manager.cc:1403] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20260429 08:00:32.355393 2363 raft_consensus.cc:359] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.355494 2363 raft_consensus.cc:385] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.355531 2363 raft_consensus.cc:740] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.355639 2363 consensus_queue.cc:260] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.355924 2363 ts_tablet_manager.cc:1434] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:32.356534 2308 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:32.356662 2308 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.356985 2308 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.357287 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29d7fe3ebc3148a9be321460da8abdb5" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:32.357411 1729 raft_consensus.cc:2468] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:32.357693 1803 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:32.357944 2308 raft_consensus.cc:2804] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:32.357933 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29d7fe3ebc3148a9be321460da8abdb5" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:32.357985 2308 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:32.358018 2308 raft_consensus.cc:3060] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.358038 2005 raft_consensus.cc:2468] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:32.358861 2308 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.359162 2308 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.359390 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29d7fe3ebc3148a9be321460da8abdb5" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:32.359432 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29d7fe3ebc3148a9be321460da8abdb5" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:32.359493 1729 raft_consensus.cc:3060] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.359530 2005 raft_consensus.cc:3060] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.360119 2005 raft_consensus.cc:2468] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:32.360301 1729 raft_consensus.cc:2468] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:32.360363 1805 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:32.360519 2308 raft_consensus.cc:2804] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:32.360616 2308 raft_consensus.cc:697] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:32.360714 2308 consensus_queue.cc:237] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.361742 2366 tablet_bootstrap.cc:492] T 43def4d831db44c09e060f4949e6f8ac P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:32.361847 2366 ts_tablet_manager.cc:1403] T 43def4d831db44c09e060f4949e6f8ac P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260429 08:00:32.362341 2366 raft_consensus.cc:359] T 43def4d831db44c09e060f4949e6f8ac P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.362444 2366 raft_consensus.cc:385] T 43def4d831db44c09e060f4949e6f8ac P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.362488 2366 raft_consensus.cc:740] T 43def4d831db44c09e060f4949e6f8ac P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.362612 2366 consensus_queue.cc:260] T 43def4d831db44c09e060f4949e6f8ac P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.362950 2366 ts_tablet_manager.cc:1434] T 43def4d831db44c09e060f4949e6f8ac P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:32.377146 2309 raft_consensus.cc:493] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:32.377270 2309 raft_consensus.cc:515] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.377696 2309 leader_election.cc:290] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.378168 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43def4d831db44c09e060f4949e6f8ac" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:32.378304 2005 raft_consensus.cc:2468] T 43def4d831db44c09e060f4949e6f8ac P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:32.378414 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43def4d831db44c09e060f4949e6f8ac" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:32.378561 1729 raft_consensus.cc:2468] T 43def4d831db44c09e060f4949e6f8ac P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:32.378923 1805 leader_election.cc:304] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:32.379190 2309 raft_consensus.cc:2804] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:32.379245 2309 raft_consensus.cc:493] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:32.379278 2309 raft_consensus.cc:3060] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.380250 2309 raft_consensus.cc:515] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.380561 2309 leader_election.cc:290] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.381174 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43def4d831db44c09e060f4949e6f8ac" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:32.381273 2005 raft_consensus.cc:3060] T 43def4d831db44c09e060f4949e6f8ac P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.382262 2005 raft_consensus.cc:2468] T 43def4d831db44c09e060f4949e6f8ac P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:32.382624 1805 leader_election.cc:304] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:32.382869 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43def4d831db44c09e060f4949e6f8ac" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:32.382961 1729 raft_consensus.cc:3060] T 43def4d831db44c09e060f4949e6f8ac P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.383908 1729 raft_consensus.cc:2468] T 43def4d831db44c09e060f4949e6f8ac P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:32.384258 2309 raft_consensus.cc:2804] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:32.384344 2309 raft_consensus.cc:697] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:32.384455 2309 consensus_queue.cc:237] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.390856 1395 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e]
I20260429 08:00:32.409857 1387 catalog_manager.cc:2174] created HMS catalog entry for table [id=a833d1ad4ead437880cfb7d73a7dd00b]
I20260429 08:00:32.421960 1387 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_99b9b733ad5c4a149389412905245938" } new_table_name: "default.Table_e2b4380a107742eab4f7945356ff2a2b" modify_external_catalogs: true
I20260429 08:00:32.423283 1846 tablet_service.cc:1511] Processing CreateTablet for tablet 50ab0c1c41f54389a6fd480da7026f20 (DEFAULT_TABLE table=default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.423467 1707 tablet_service.cc:1511] Processing CreateTablet for tablet 50ab0c1c41f54389a6fd480da7026f20 (DEFAULT_TABLE table=default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.423573 1846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ab0c1c41f54389a6fd480da7026f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.423506 1983 tablet_service.cc:1511] Processing CreateTablet for tablet 50ab0c1c41f54389a6fd480da7026f20 (DEFAULT_TABLE table=default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.423676 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ab0c1c41f54389a6fd480da7026f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.423776 1983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ab0c1c41f54389a6fd480da7026f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.425642 2366 tablet_bootstrap.cc:492] T 50ab0c1c41f54389a6fd480da7026f20 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:32.425843 2363 tablet_bootstrap.cc:492] T 50ab0c1c41f54389a6fd480da7026f20 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:32.426565 2366 tablet_bootstrap.cc:654] T 50ab0c1c41f54389a6fd480da7026f20 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.426707 2363 tablet_bootstrap.cc:654] T 50ab0c1c41f54389a6fd480da7026f20 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.427290 2359 tablet_bootstrap.cc:492] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:32.428165 2359 tablet_bootstrap.cc:654] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.430578 2359 tablet_bootstrap.cc:492] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:32.430655 2359 ts_tablet_manager.cc:1403] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260429 08:00:32.430977 2366 tablet_bootstrap.cc:492] T 50ab0c1c41f54389a6fd480da7026f20 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:32.431059 2366 ts_tablet_manager.cc:1403] T 50ab0c1c41f54389a6fd480da7026f20 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260429 08:00:32.431071 2359 raft_consensus.cc:359] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.431165 2359 raft_consensus.cc:385] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.431193 2359 raft_consensus.cc:740] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.431296 2359 consensus_queue.cc:260] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.431494 2366 raft_consensus.cc:359] T 50ab0c1c41f54389a6fd480da7026f20 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.431569 2359 ts_tablet_manager.cc:1434] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:32.431597 2366 raft_consensus.cc:385] T 50ab0c1c41f54389a6fd480da7026f20 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.431633 2366 raft_consensus.cc:740] T 50ab0c1c41f54389a6fd480da7026f20 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.431763 2366 consensus_queue.cc:260] T 50ab0c1c41f54389a6fd480da7026f20 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.432041 2366 ts_tablet_manager.cc:1434] T 50ab0c1c41f54389a6fd480da7026f20 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:32.434376 2363 tablet_bootstrap.cc:492] T 50ab0c1c41f54389a6fd480da7026f20 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:32.434455 2363 ts_tablet_manager.cc:1403] T 50ab0c1c41f54389a6fd480da7026f20 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260429 08:00:32.434880 2363 raft_consensus.cc:359] T 50ab0c1c41f54389a6fd480da7026f20 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.434970 2363 raft_consensus.cc:385] T 50ab0c1c41f54389a6fd480da7026f20 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.434998 2363 raft_consensus.cc:740] T 50ab0c1c41f54389a6fd480da7026f20 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.435102 2363 consensus_queue.cc:260] T 50ab0c1c41f54389a6fd480da7026f20 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.435344 2363 ts_tablet_manager.cc:1434] T 50ab0c1c41f54389a6fd480da7026f20 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:32.467177 1389 catalog_manager.cc:3502] renamed table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07] in HMS: new name default.table_1bb6d84b6ef5474eb7270ecbd2c1af77
I20260429 08:00:32.476861 2382 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:32.476987 2382 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.477404 2382 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.477972 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c2987616df4a438b5160e1fbc5387e" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:32.478096 1867 raft_consensus.cc:2468] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:32.478598 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c2987616df4a438b5160e1fbc5387e" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:32.478703 1666 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:32.478727 2005 raft_consensus.cc:2468] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:32.479085 2382 raft_consensus.cc:2804] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:32.479149 2382 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:32.479197 2382 raft_consensus.cc:3060] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.480353 2382 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.480683 2382 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Requested vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.481046 2005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c2987616df4a438b5160e1fbc5387e" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:32.481186 2005 raft_consensus.cc:3060] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.481293 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c2987616df4a438b5160e1fbc5387e" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:32.481389 1867 raft_consensus.cc:3060] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.482256 2005 raft_consensus.cc:2468] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:32.482360 1867 raft_consensus.cc:2468] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:32.482546 1667 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:32.482730 2382 raft_consensus.cc:2804] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:32.482790 2382 raft_consensus.cc:697] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Becoming Leader. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Running, Role: LEADER
I20260429 08:00:32.482930 2382 consensus_queue.cc:237] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.485061 2230 raft_consensus.cc:493] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:32.485137 2230 raft_consensus.cc:515] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.485451 2230 leader_election.cc:290] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:32.485909 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ab0c1c41f54389a6fd480da7026f20" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:32.486016 1867 raft_consensus.cc:2468] T 50ab0c1c41f54389a6fd480da7026f20 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:32.486550 1939 leader_election.cc:304] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:32.487092 2230 raft_consensus.cc:2804] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:32.487147 2230 raft_consensus.cc:493] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:32.487182 2230 raft_consensus.cc:3060] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.488075 2230 raft_consensus.cc:515] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.488361 2230 leader_election.cc:290] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:32.489025 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ab0c1c41f54389a6fd480da7026f20" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:32.489152 1867 raft_consensus.cc:3060] T 50ab0c1c41f54389a6fd480da7026f20 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.489245 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ab0c1c41f54389a6fd480da7026f20" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:32.489322 1730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ab0c1c41f54389a6fd480da7026f20" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:32.489342 1729 raft_consensus.cc:2468] T 50ab0c1c41f54389a6fd480da7026f20 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:32.489974 1867 raft_consensus.cc:2468] T 50ab0c1c41f54389a6fd480da7026f20 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:32.490264 1939 leader_election.cc:304] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters: 6441a846e67a46159cef1413b6d06337
I20260429 08:00:32.490635 2229 consensus_queue.cc:1048] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.491158 2230 raft_consensus.cc:2804] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:32.491308 2230 raft_consensus.cc:697] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [term 1 LEADER]: Becoming Leader. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Running, Role: LEADER
I20260429 08:00:32.491412 2230 consensus_queue.cc:237] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.493724 1386 catalog_manager.cc:2174] created HMS catalog entry for table [id=43f8b9c7990542d39c679d80b77db9c8]
I20260429 08:00:32.495214 2309 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:32.495296 2309 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.495640 2309 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.496655 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b29c11f78624a22922bae3070f194f3" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:32.496749 2004 raft_consensus.cc:2468] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:32.497140 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b29c11f78624a22922bae3070f194f3" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:32.497248 1729 raft_consensus.cc:2468] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:32.497376 1805 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:32.497516 2309 raft_consensus.cc:2804] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:32.497557 2309 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:32.497591 2309 raft_consensus.cc:3060] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.498152 2337 consensus_queue.cc:1048] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.498413 2309 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.498714 2309 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
F20260429 08:00:32.499383 1607 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 23, previous 23; dumping first 4 out of 13 received events: NotificationEvent(eventId=21, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_207de250815e4c1793355de8d028abec, message={"server":"","servicePrincipal":"","db":"default","table":"table_207de250815e4c1793355de8d028abec","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_207de250815e4c1793355de8d028abec\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_207de250815e4c1793355de8d028abec\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_207de250815e4c1793355de8d028abec\",\"kudu.table_id\":\"76db81fc69b8490d98c0496a830d00c2\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1777449632, eventType=CREATE_TABLE, dbName=default, tableName=table_91fe24cd92b444e1bd97440b6e584816, message={"server":"","servicePrincipal":"","db":"default","table":"table_91fe24cd92b444e1bd97440b6e584816","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_91fe24cd92b444e1bd97440b6e584816\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449632},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_91fe24cd92b444e1bd97440b6e584816\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_91fe24cd92b444e1bd97440b6e584816\",\"kudu.table_id\":\"85f2230320084f08a7b147f7efd77ed1\",\"transient_lastDdlTime\":\"1777449632\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_34261e3d16e14d888f3f3fd3c436b4ad, message={"server":"","servicePrincipal":"","db":"default","table":"table_34261e3d16e14d888f3f3fd3c436b4ad","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449630},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_34261e3d16e14d888f3f3fd3c436b4ad\",\"kudu.table_id\":\"ba5133c5668141589469ba6e26f75c47\",\"transient_lastDdlTime\":\"1777449630\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_012320bc4c054b62be2e415bca912daf, message={"server":"","servicePrincipal":"","db":"default","table":"table_012320bc4c054b62be2e415bca912daf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_012320bc4c054b62be2e415bca912daf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_012320bc4c054b62be2e415bca912daf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_012320bc4c054b62be2e415bca912daf\",\"kudu.table_id\":\"038ee5f1404b4d3ca452c21bfa0253e6\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260429 08:00:32.501674 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b29c11f78624a22922bae3070f194f3" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:32.501786 1729 raft_consensus.cc:3060] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.502323 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b29c11f78624a22922bae3070f194f3" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:32.502420 2004 raft_consensus.cc:3060] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.502787 1729 raft_consensus.cc:2468] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:32.503060 1803 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:32.503188 2309 raft_consensus.cc:2804] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:32.503278 2309 raft_consensus.cc:697] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:32.503355 2004 raft_consensus.cc:2468] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:32.503412 2309 consensus_queue.cc:237] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
@ 0x7fcdbadc4dcd google::LogMessage::Fail() at ??:0
@ 0x7fcdbadc8b93 google::LogMessage::SendToLog() at ??:0
I20260429 08:00:32.508857 1707 tablet_service.cc:1511] Processing CreateTablet for tablet 6fed5cc1d4c045408c1b3342e8baba02 (DEFAULT_TABLE table=default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.508989 1846 tablet_service.cc:1511] Processing CreateTablet for tablet 6fed5cc1d4c045408c1b3342e8baba02 (DEFAULT_TABLE table=default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.509106 1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fed5cc1d4c045408c1b3342e8baba02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.509202 1846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fed5cc1d4c045408c1b3342e8baba02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:32.509364 1386 catalog_manager.cc:5671] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 353e59f343974ee68738535fb9029d30 (127.1.14.2). New cstate: current_term: 1 leader_uuid: "353e59f343974ee68738535fb9029d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:32.509581 1386 catalog_manager.cc:5671] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 353e59f343974ee68738535fb9029d30 (127.1.14.2). New cstate: current_term: 1 leader_uuid: "353e59f343974ee68738535fb9029d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:32.509694 1386 catalog_manager.cc:5763] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223) does not have the latest schema for tablet 29d7fe3ebc3148a9be321460da8abdb5 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]). Expected version 1 got 0
@ 0x7fcdbadc47cc google::LogMessage::Flush() at ??:0
I20260429 08:00:32.510775 2363 tablet_bootstrap.cc:492] T 6fed5cc1d4c045408c1b3342e8baba02 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:32.511752 2363 tablet_bootstrap.cc:654] T 6fed5cc1d4c045408c1b3342e8baba02 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.511986 2366 tablet_bootstrap.cc:492] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:32.512166 1983 tablet_service.cc:1511] Processing CreateTablet for tablet 6fed5cc1d4c045408c1b3342e8baba02 (DEFAULT_TABLE table=default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:32.512403 1983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fed5cc1d4c045408c1b3342e8baba02. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fcdbadc4a11 google::LogMessage::~LogMessage() at ??:0
I20260429 08:00:32.513356 2366 tablet_bootstrap.cc:654] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.514163 2359 tablet_bootstrap.cc:492] T 6fed5cc1d4c045408c1b3342e8baba02 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:32.514823 2366 tablet_bootstrap.cc:492] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:32.514891 2366 ts_tablet_manager.cc:1403] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260429 08:00:32.514982 2359 tablet_bootstrap.cc:654] T 6fed5cc1d4c045408c1b3342e8baba02 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:32.515316 2366 raft_consensus.cc:359] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.515409 2366 raft_consensus.cc:385] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.515441 2366 raft_consensus.cc:740] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.515545 2366 consensus_queue.cc:260] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.515792 2366 ts_tablet_manager.cc:1434] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:32.517305 2359 tablet_bootstrap.cc:492] T 6fed5cc1d4c045408c1b3342e8baba02 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:32.517372 2359 ts_tablet_manager.cc:1403] T 6fed5cc1d4c045408c1b3342e8baba02 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260429 08:00:32.517787 2359 raft_consensus.cc:359] T 6fed5cc1d4c045408c1b3342e8baba02 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.517870 2359 raft_consensus.cc:385] T 6fed5cc1d4c045408c1b3342e8baba02 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.517900 2359 raft_consensus.cc:740] T 6fed5cc1d4c045408c1b3342e8baba02 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.518006 2359 consensus_queue.cc:260] T 6fed5cc1d4c045408c1b3342e8baba02 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.518253 2359 ts_tablet_manager.cc:1434] T 6fed5cc1d4c045408c1b3342e8baba02 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:32.518230 1386 catalog_manager.cc:5671] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6441a846e67a46159cef1413b6d06337 (127.1.14.1). New cstate: current_term: 1 leader_uuid: "6441a846e67a46159cef1413b6d06337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:32.522883 1386 catalog_manager.cc:5671] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a reported cstate change: term changed from 0 to 1, leader changed from <none> to 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3). New cstate: current_term: 1 leader_uuid: "873f2b4fab6f42738b2d41b4608a592a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: HEALTHY } } }
@ 0x7fcdc0338433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260429 08:00:32.527202 1386 catalog_manager.cc:5671] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 353e59f343974ee68738535fb9029d30 (127.1.14.2). New cstate: current_term: 1 leader_uuid: "353e59f343974ee68738535fb9029d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260429 08:00:32.531312 1386 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34848:
table { table_name: "default.Table_91fe24cd92b444e1bd97440b6e584816" } new_table_name: "default.Table_85410940ba1345d08dcf40344274439a" modify_external_catalogs: true
I20260429 08:00:32.532920 2363 tablet_bootstrap.cc:492] T 6fed5cc1d4c045408c1b3342e8baba02 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:32.533002 2363 ts_tablet_manager.cc:1403] T 6fed5cc1d4c045408c1b3342e8baba02 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.001s
I20260429 08:00:32.533531 2363 raft_consensus.cc:359] T 6fed5cc1d4c045408c1b3342e8baba02 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.533630 2363 raft_consensus.cc:385] T 6fed5cc1d4c045408c1b3342e8baba02 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:32.533663 2363 raft_consensus.cc:740] T 6fed5cc1d4c045408c1b3342e8baba02 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:32.533787 2363 consensus_queue.cc:260] T 6fed5cc1d4c045408c1b3342e8baba02 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.534116 2363 ts_tablet_manager.cc:1434] T 6fed5cc1d4c045408c1b3342e8baba02 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
@ 0x7fcdc033734a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7fcdc0336aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
@ 0x7fcdc033c1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x55dc316b0244 std::function<>::operator()() at ??:0
@ 0x7fcdbc2c97ea kudu::Thread::SuperviseThread() at ??:0
@ 0x7fcdbcc0e6db start_thread at ??:0
@ 0x7fcdb9f7b61f clone at ??:0
I20260429 08:00:32.598284 2337 raft_consensus.cc:493] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:32.598424 2337 raft_consensus.cc:515] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.598845 2337 leader_election.cc:290] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.599226 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fed5cc1d4c045408c1b3342e8baba02" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:32.599246 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fed5cc1d4c045408c1b3342e8baba02" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:32.599364 1867 raft_consensus.cc:2468] T 6fed5cc1d4c045408c1b3342e8baba02 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:32.599378 2004 raft_consensus.cc:2468] T 6fed5cc1d4c045408c1b3342e8baba02 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:32.599630 1666 leader_election.cc:304] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
I20260429 08:00:32.599787 2337 raft_consensus.cc:2804] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:32.599857 2337 raft_consensus.cc:493] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:32.599890 2337 raft_consensus.cc:3060] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.600734 2337 raft_consensus.cc:515] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:32.601068 2337 leader_election.cc:290] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Requested vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:32.601348 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fed5cc1d4c045408c1b3342e8baba02" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:32.601383 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fed5cc1d4c045408c1b3342e8baba02" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:32.601468 1867 raft_consensus.cc:3060] T 6fed5cc1d4c045408c1b3342e8baba02 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.601493 2004 raft_consensus.cc:3060] T 6fed5cc1d4c045408c1b3342e8baba02 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.602372 1867 raft_consensus.cc:2468] T 6fed5cc1d4c045408c1b3342e8baba02 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:32.602372 2004 raft_consensus.cc:2468] T 6fed5cc1d4c045408c1b3342e8baba02 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:32.602675 1667 leader_election.cc:304] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:32.602857 2337 raft_consensus.cc:2804] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:32.602988 2337 raft_consensus.cc:697] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Becoming Leader. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Running, Role: LEADER
I20260429 08:00:32.603142 2337 consensus_queue.cc:237] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
W20260429 08:00:32.710345 1667 connection.cc:570] client connection to 127.1.14.62:41885 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:32.710937 2061 connection.cc:570] client connection to 127.1.14.62:41885 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260429 08:00:32.737516 2309 consensus_queue.cc:1048] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.741398 2238 consensus_queue.cc:1048] T 5a2349526fb740f4b9c964cb9ecef4d6 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.775312 2238 consensus_queue.cc:1048] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.778172 2238 consensus_queue.cc:1048] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.839789 2238 consensus_queue.cc:1048] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.843146 2232 consensus_queue.cc:1048] T 43def4d831db44c09e060f4949e6f8ac P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.866840 2337 consensus_queue.cc:1048] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.874097 2260 consensus_queue.cc:1048] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.891438 1729 raft_consensus.cc:3060] T 50ab0c1c41f54389a6fd480da7026f20 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:32.901407 2417 consensus_queue.cc:1048] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.907560 2230 consensus_queue.cc:1048] T 50ab0c1c41f54389a6fd480da7026f20 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:32.999964 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.60:41737
--webserver_interface=127.1.14.60
--webserver_port=45447
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260429 08:00:33.006780 2308 consensus_queue.cc:1048] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:33.009899 2308 consensus_queue.cc:1048] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:33.031006 2456 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7c20d1745e54a9db1e0082a48ed06e4)
I20260429 08:00:33.031201 2456 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:33.031683 2456 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:33.032735 1453 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20260429 08:00:33.033807 1453 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:00:33.033921 2229 consensus_queue.cc:1048] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260429 08:00:33.034490 1453 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:33.034559 1453 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:33.034689 2456 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260429 08:00:33.038672 2260 consensus_queue.cc:1048] T 6fed5cc1d4c045408c1b3342e8baba02 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260429 08:00:33.124392 2453 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:33.124627 2453 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:33.124672 2453 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:33.127895 2453 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 08:00:33.127944 2453 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:33.127964 2453 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 08:00:33.127979 2453 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 08:00:33.131623 2453 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.60:41737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.14.60
--webserver_port=45447
--never_fsync=true
--heap_profile_path=/tmp/kudu.2453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:33.132738 2453 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:33.133826 2453 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:33.139007 2466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:33.139007 2469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:33.139024 2467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:33.139303 2453 server_base.cc:1061] running on GCE node
I20260429 08:00:33.139735 2453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:33.140549 2453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:33.141747 2453 hybrid_clock.cc:648] HybridClock initialized: now 1777449633141725 us; error 33 us; skew 500 ppm
I20260429 08:00:33.143416 2453 webserver.cc:492] Webserver started at http://127.1.14.60:45447/ using document root <none> and password file <none>
I20260429 08:00:33.143942 2453 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:33.143994 2453 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:33.147056 1434 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:00:33.147197 1434 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:33.147763 2453 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.001s sys 0.001s
I20260429 08:00:33.149608 2475 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:33.150454 2453 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:33.150579 2453 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
uuid: "cd076a6196ef424a813003c9c5d53d42"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:33.150947 2453 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:33.180348 2453 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:33.180970 2453 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:33.181136 2453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:33.187580 2453 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.60:41737
I20260429 08:00:33.187582 2527 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.60:41737 every 8 connection(s)
I20260429 08:00:33.188457 2453 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/info.pb
I20260429 08:00:33.191951 2528 sys_catalog.cc:263] Verifying existing consensus state
I20260429 08:00:33.193457 2528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Bootstrap starting.
I20260429 08:00:33.197579 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 2453
I20260429 08:00:33.203310 2528 log.cc:826] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:33.241384 2528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Bootstrap replayed 1/1 log segments. Stats: ops{read=76 overwritten=0 applied=76 ignored=0} inserts{seen=47 ignored=0} mutations{seen=64 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 08:00:33.241902 2528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Bootstrap complete.
I20260429 08:00:33.244650 2528 raft_consensus.cc:359] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:33.244975 2528 raft_consensus.cc:740] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd076a6196ef424a813003c9c5d53d42, State: Initialized, Role: FOLLOWER
I20260429 08:00:33.245381 2528 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 76, Last appended: 3.76, Last appended by leader: 76, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:33.245774 2533 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:33.245920 2533 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:33.246408 2528 sys_catalog.cc:565] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: configured and running, proceeding with master startup.
I20260429 08:00:33.252635 2547 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:33.252683 2547 catalog_manager.cc:1562] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: loading cluster ID for follower catalog manager: success
I20260429 08:00:33.251181 2453 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:00:33.253257 2453 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:33.254843 2547 catalog_manager.cc:1584] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: acquiring CA information for follower catalog manager: success
I20260429 08:00:33.256276 2547 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260429 08:00:33.272070 1915 heartbeater.cc:344] Connected to a master server at 127.1.14.60:41737
I20260429 08:00:33.274220 2492 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "353e59f343974ee68738535fb9029d30" instance_seqno: 1777449628847581) as {username='slave'} at 127.1.14.2:45423; Asking this server to re-register.
I20260429 08:00:33.274694 1915 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:33.276243 2492 ts_manager.cc:194] Registered new tserver with Master: 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:33.439795 2051 heartbeater.cc:344] Connected to a master server at 127.1.14.60:41737
I20260429 08:00:33.440883 2491 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" instance_seqno: 1777449629023571) as {username='slave'} at 127.1.14.3:44787; Asking this server to re-register.
I20260429 08:00:33.441284 2051 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:33.442148 2491 ts_manager.cc:194] Registered new tserver with Master: 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:33.498205 1777 heartbeater.cc:344] Connected to a master server at 127.1.14.60:41737
I20260429 08:00:33.499328 2491 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6441a846e67a46159cef1413b6d06337" instance_seqno: 1777449628680786) as {username='slave'} at 127.1.14.1:43051; Asking this server to re-register.
I20260429 08:00:33.499717 1777 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:33.500610 2491 ts_manager.cc:194] Registered new tserver with Master: 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:33.646663 2533 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:33.646855 2533 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:33.648257 2533 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
W20260429 08:00:33.648816 2479 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:33.649696 2479 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:00:33.652311 1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd076a6196ef424a813003c9c5d53d42" candidate_term: 4 candidate_status { last_received { term: 3 index: 76 } } ignore_live_leader: false dest_uuid: "f1e6af049ae04c6e98cb5e609f9be472" is_pre_election: true
I20260429 08:00:33.652454 1476 raft_consensus.cc:2410] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd076a6196ef424a813003c9c5d53d42 for term 4 because replica has last-logged OpId of term: 3 index: 87, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 76.
I20260429 08:00:33.652925 2476 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42; no voters: d7c20d1745e54a9db1e0082a48ed06e4, f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:33.653180 2533 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260429 08:00:33.784304 2557 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7c20d1745e54a9db1e0082a48ed06e4)
I20260429 08:00:33.784428 2557 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:33.784897 2557 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:33.786356 1453 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:00:33.788475 2502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1e6af049ae04c6e98cb5e609f9be472" candidate_term: 4 candidate_status { last_received { term: 3 index: 87 } } ignore_live_leader: false dest_uuid: "cd076a6196ef424a813003c9c5d53d42" is_pre_election: true
I20260429 08:00:33.788767 2502 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1e6af049ae04c6e98cb5e609f9be472 in term 3.
I20260429 08:00:33.789103 1453 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, f1e6af049ae04c6e98cb5e609f9be472; no voters: d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:33.789273 2557 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260429 08:00:33.789340 2557 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d7c20d1745e54a9db1e0082a48ed06e4)
I20260429 08:00:33.789373 2557 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 3 FOLLOWER]: Advancing to term 4
I20260429 08:00:33.802261 2557 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:33.802634 2557 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 4 election: Requested vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
I20260429 08:00:33.803360 2502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1e6af049ae04c6e98cb5e609f9be472" candidate_term: 4 candidate_status { last_received { term: 3 index: 87 } } ignore_live_leader: false dest_uuid: "cd076a6196ef424a813003c9c5d53d42"
I20260429 08:00:33.803480 2502 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 3 FOLLOWER]: Advancing to term 4
W20260429 08:00:33.803963 1453 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:00:33.806124 2502 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1e6af049ae04c6e98cb5e609f9be472 in term 4.
I20260429 08:00:33.806419 1453 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, f1e6af049ae04c6e98cb5e609f9be472; no voters: d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:33.806593 2557 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 4 FOLLOWER]: Leader election won for term 4
I20260429 08:00:33.806797 2557 raft_consensus.cc:697] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 4 LEADER]: Becoming Leader. State: Replica: f1e6af049ae04c6e98cb5e609f9be472, State: Running, Role: LEADER
I20260429 08:00:33.806951 2557 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 3.87, Last appended by leader: 87, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:33.807567 2561 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1e6af049ae04c6e98cb5e609f9be472. Latest consensus state: current_term: 4 leader_uuid: "f1e6af049ae04c6e98cb5e609f9be472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:33.807675 2561 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:33.807919 2563 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260429 08:00:33.809226 2563 catalog_manager.cc:679] Loaded metadata for table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]
I20260429 08:00:33.809459 2563 catalog_manager.cc:679] Loaded metadata for table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e]
I20260429 08:00:33.809669 2563 catalog_manager.cc:679] Loaded metadata for table default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8]
I20260429 08:00:33.809906 2563 catalog_manager.cc:679] Loaded metadata for table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]
I20260429 08:00:33.810218 2563 catalog_manager.cc:679] Loaded metadata for table default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156]
I20260429 08:00:33.810438 2563 catalog_manager.cc:679] Loaded metadata for table default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1]
I20260429 08:00:33.810642 2563 catalog_manager.cc:679] Loaded metadata for table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]
I20260429 08:00:33.810860 2563 catalog_manager.cc:679] Loaded metadata for table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]
I20260429 08:00:33.811064 2563 catalog_manager.cc:679] Loaded metadata for table default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3]
I20260429 08:00:33.811265 2563 catalog_manager.cc:679] Loaded metadata for table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]
I20260429 08:00:33.811503 2563 catalog_manager.cc:679] Loaded metadata for table default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b]
I20260429 08:00:33.811707 2563 catalog_manager.cc:679] Loaded metadata for table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]
I20260429 08:00:33.811928 2563 catalog_manager.cc:679] Loaded metadata for table default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b]
I20260429 08:00:33.812230 2563 catalog_manager.cc:679] Loaded metadata for table default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5]
I20260429 08:00:33.813316 2563 tablet_loader.cc:96] loaded metadata for tablet 29d7fe3ebc3148a9be321460da8abdb5 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08])
I20260429 08:00:33.813660 2563 tablet_loader.cc:96] loaded metadata for tablet 3b29c11f78624a22922bae3070f194f3 (table default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1])
I20260429 08:00:33.813863 2563 tablet_loader.cc:96] loaded metadata for tablet 3d4069c79e8f4c36ba414169bd049b8f (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91])
I20260429 08:00:33.814039 2563 tablet_loader.cc:96] loaded metadata for tablet 43def4d831db44c09e060f4949e6f8ac (table default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b])
I20260429 08:00:33.814214 2563 tablet_loader.cc:96] loaded metadata for tablet 50ab0c1c41f54389a6fd480da7026f20 (table default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b])
I20260429 08:00:33.814473 2563 tablet_loader.cc:96] loaded metadata for tablet 5a2349526fb740f4b9c964cb9ecef4d6 (table default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5])
I20260429 08:00:33.814741 2563 tablet_loader.cc:96] loaded metadata for tablet 6fed5cc1d4c045408c1b3342e8baba02 (table default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8])
I20260429 08:00:33.814910 2563 tablet_loader.cc:96] loaded metadata for tablet 81c91c679c114775bd302d89f0996393 (table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47])
I20260429 08:00:33.815090 2563 tablet_loader.cc:96] loaded metadata for tablet 881e1249f58b4480ad5940e69ee49788 (table default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3])
I20260429 08:00:33.815371 2563 tablet_loader.cc:96] loaded metadata for tablet 93630bad9fdd46e9b982cd1b44665433 (table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e])
I20260429 08:00:33.815764 2563 tablet_loader.cc:96] loaded metadata for tablet c1c2987616df4a438b5160e1fbc5387e (table default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156])
I20260429 08:00:33.815935 2563 tablet_loader.cc:96] loaded metadata for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07])
I20260429 08:00:33.816179 2563 tablet_loader.cc:96] loaded metadata for tablet d1ee8252269e41e3bbe96fa3a43d4d9e (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2])
I20260429 08:00:33.816354 2563 tablet_loader.cc:96] loaded metadata for tablet e2cfe56e4eca41c0b8ce2f3210f035ea (table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006])
I20260429 08:00:33.816677 2563 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260429 08:00:33.817164 2563 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:33.817205 2563 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260429 08:00:33.817822 2563 catalog_manager.cc:1514] Loading token signing keys...
I20260429 08:00:33.818274 2563 catalog_manager.cc:6055] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Loaded TSK: 0
I20260429 08:00:33.818522 2563 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260429 08:00:33.819065 2563 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260429 08:00:33.819497 2563 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 20
I20260429 08:00:33.849704 1465 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_ba60f2d687a9431288851fb68b310758"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:33.849846 1458 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_eec10405ada64deba7b1528381398882"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:33.850142 1463 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_cc83324222db4bf980b1244fe6100d93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:33.850167 1461 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_7d22f9579cdc49118b40da3544eeee0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:33.850217 1460 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58408:
table { table_name: "default.Table_3b6223798dcd434c989986f1d5727b55" } new_table_name: "default.Table_2cdd9567b5794d2f89bd56027f9fe823" modify_external_catalogs: true
I20260429 08:00:33.850404 1459 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_207de250815e4c1793355de8d028abec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:33.850610 1466 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_e71df0e290ff44a1b6d66b910af211c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:33.850785 1462 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_baf66e1ed64348eda0d85f89019f9f49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:33.850934 1464 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_012320bc4c054b62be2e415bca912daf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:33.850978 1457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58408:
name: "default.Table_1f3eaa53e74241cc830474cdcc774f87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260429 08:00:33.858168 1632 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 23, previous 23; dumping first 4 out of 13 received events: NotificationEvent(eventId=21, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_207de250815e4c1793355de8d028abec, message={"server":"","servicePrincipal":"","db":"default","table":"table_207de250815e4c1793355de8d028abec","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_207de250815e4c1793355de8d028abec\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_207de250815e4c1793355de8d028abec\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_207de250815e4c1793355de8d028abec\",\"kudu.table_id\":\"76db81fc69b8490d98c0496a830d00c2\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1777449632, eventType=CREATE_TABLE, dbName=default, tableName=table_91fe24cd92b444e1bd97440b6e584816, message={"server":"","servicePrincipal":"","db":"default","table":"table_91fe24cd92b444e1bd97440b6e584816","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_91fe24cd92b444e1bd97440b6e584816\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449632},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_91fe24cd92b444e1bd97440b6e584816\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_91fe24cd92b444e1bd97440b6e584816\",\"kudu.table_id\":\"85f2230320084f08a7b147f7efd77ed1\",\"transient_lastDdlTime\":\"1777449632\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_34261e3d16e14d888f3f3fd3c436b4ad, message={"server":"","servicePrincipal":"","db":"default","table":"table_34261e3d16e14d888f3f3fd3c436b4ad","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449630},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_34261e3d16e14d888f3f3fd3c436b4ad\",\"kudu.table_id\":\"ba5133c5668141589469ba6e26f75c47\",\"transient_lastDdlTime\":\"1777449630\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_012320bc4c054b62be2e415bca912daf, message={"server":"","servicePrincipal":"","db":"default","table":"table_012320bc4c054b62be2e415bca912daf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_012320bc4c054b62be2e415bca912daf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_012320bc4c054b62be2e415bca912daf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_012320bc4c054b62be2e415bca912daf\",\"kudu.table_id\":\"038ee5f1404b4d3ca452c21bfa0253e6\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f2caa5d3dcd google::LogMessage::Fail() at ??:0
@ 0x7f2caa5d7b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f2caa5d37cc google::LogMessage::Flush() at ??:0
@ 0x7f2caa5d3a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7f2cafb47433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f2cafb4634a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f2cafb45aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
@ 0x7f2cafb4b1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x560681ffa244 std::function<>::operator()() at ??:0
@ 0x7f2cabad87ea kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2cac41d6db start_thread at ??:0
@ 0x7f2ca978a61f clone at ??:0
W20260429 08:00:34.047381 1937 connection.cc:570] client connection to 127.1.14.61:33847 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:34.047348 1802 connection.cc:570] client connection to 127.1.14.61:33847 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:34.047796 2058 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.1.14.61:33847)
W20260429 08:00:34.047953 2058 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.1.14.61:33847)
W20260429 08:00:34.048141 2058 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.14.61:33847)
W20260429 08:00:34.048455 2058 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.1.14.61:33847)
I20260429 08:00:34.733774 2587 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:34.733911 2587 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:34.734311 2587 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
W20260429 08:00:34.735375 2476 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
W20260429 08:00:34.735481 2479 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:00:34.735554 2479 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42; no voters: d7c20d1745e54a9db1e0082a48ed06e4, f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:34.735675 2587 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260429 08:00:35.556906 2597 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:35.557036 2597 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:35.557426 2597 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
W20260429 08:00:35.558503 2479 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:35.558621 2476 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:35.558693 2476 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42; no voters: d7c20d1745e54a9db1e0082a48ed06e4, f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:35.558812 2597 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260429 08:00:36.116870 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.62:41885
--webserver_interface=127.1.14.62
--webserver_port=35601
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260429 08:00:36.239452 2606 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:36.239632 2606 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:36.239697 2606 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:36.242954 2606 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 08:00:36.242998 2606 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:36.243042 2606 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 08:00:36.243077 2606 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 08:00:36.246732 2606 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.62:41885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.14.62
--webserver_port=35601
--never_fsync=true
--heap_profile_path=/tmp/kudu.2606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:36.247756 2606 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:36.248814 2606 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260429 08:00:36.254194 2606 server_base.cc:1061] running on GCE node
W20260429 08:00:36.254153 2613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:36.254190 2612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:36.254148 2615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:36.254840 2606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:36.255661 2606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:36.256798 2606 hybrid_clock.cc:648] HybridClock initialized: now 1777449636256771 us; error 36 us; skew 500 ppm
I20260429 08:00:36.258482 2606 webserver.cc:492] Webserver started at http://127.1.14.62:35601/ using document root <none> and password file <none>
I20260429 08:00:36.259060 2606 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:36.259145 2606 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:36.263270 2606 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260429 08:00:36.265348 2621 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:36.266418 2606 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260429 08:00:36.266532 2606 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
uuid: "d7c20d1745e54a9db1e0082a48ed06e4"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:36.266899 2606 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:36.276508 2606 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:36.277062 2606 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:36.277225 2606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:36.283917 2606 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.62:41885
I20260429 08:00:36.283914 2673 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.62:41885 every 8 connection(s)
I20260429 08:00:36.285192 2606 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/info.pb
I20260429 08:00:36.288970 2674 sys_catalog.cc:263] Verifying existing consensus state
I20260429 08:00:36.290560 2674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Bootstrap starting.
I20260429 08:00:36.293856 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 2606
I20260429 08:00:36.303646 2674 log.cc:826] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:36.346477 2674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=87 overwritten=0 applied=87 ignored=0} inserts{seen=53 ignored=0} mutations{seen=73 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 08:00:36.346853 2674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Bootstrap complete.
I20260429 08:00:36.349560 2674 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:36.349928 2674 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7c20d1745e54a9db1e0082a48ed06e4, State: Initialized, Role: FOLLOWER
I20260429 08:00:36.350317 2674 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 87, Last appended: 3.87, Last appended by leader: 87, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:36.350701 2680 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:36.350849 2680 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:36.351361 2674 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260429 08:00:36.357729 2694 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:36.357861 2694 catalog_manager.cc:1562] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: loading cluster ID for follower catalog manager: success
I20260429 08:00:36.360570 2694 catalog_manager.cc:1584] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: acquiring CA information for follower catalog manager: success
I20260429 08:00:36.362792 2694 catalog_manager.cc:1612] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260429 08:00:36.367585 2606 master_runner.cc:186] Error getting master registration for 127.1.14.61:33847: Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111),
I20260429 08:00:36.369751 2606 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:36.447204 2052 heartbeater.cc:344] Connected to a master server at 127.1.14.62:41885
I20260429 08:00:36.449605 2638 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" instance_seqno: 1777449629023571) as {username='slave'} at 127.1.14.3:56585; Asking this server to re-register.
I20260429 08:00:36.450163 2052 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:36.451346 2638 ts_manager.cc:194] Registered new tserver with Master: 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:36.530747 1916 heartbeater.cc:344] Connected to a master server at 127.1.14.62:41885
I20260429 08:00:36.531992 2638 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "353e59f343974ee68738535fb9029d30" instance_seqno: 1777449628847581) as {username='slave'} at 127.1.14.2:40863; Asking this server to re-register.
I20260429 08:00:36.532438 1916 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:36.533346 2638 ts_manager.cc:194] Registered new tserver with Master: 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:36.641696 1778 heartbeater.cc:344] Connected to a master server at 127.1.14.62:41885
I20260429 08:00:36.643057 2638 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6441a846e67a46159cef1413b6d06337" instance_seqno: 1777449628680786) as {username='slave'} at 127.1.14.1:50967; Asking this server to re-register.
I20260429 08:00:36.643409 1778 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:36.644196 2638 ts_manager.cc:194] Registered new tserver with Master: 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:36.968550 2701 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:36.968779 2701 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:36.969931 2701 leader_election.cc:290] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:36.970515 2622 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
W20260429 08:00:36.971309 2622 leader_election.cc:336] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:36.973508 2502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 87 } } ignore_live_leader: false dest_uuid: "cd076a6196ef424a813003c9c5d53d42" is_pre_election: true
I20260429 08:00:36.973717 2502 raft_consensus.cc:2393] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7c20d1745e54a9db1e0082a48ed06e4 in current term 4: Already voted for candidate f1e6af049ae04c6e98cb5e609f9be472 in this term.
I20260429 08:00:36.974145 2625 leader_election.cc:304] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7c20d1745e54a9db1e0082a48ed06e4; no voters: cd076a6196ef424a813003c9c5d53d42, f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:36.974190 2706 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:36.974308 2706 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:36.974364 2701 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 3 FOLLOWER]: Advancing to term 4
I20260429 08:00:36.974674 2706 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
I20260429 08:00:36.976608 2701 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260429 08:00:36.976984 2476 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:36.978180 2648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd076a6196ef424a813003c9c5d53d42" candidate_term: 5 candidate_status { last_received { term: 3 index: 76 } } ignore_live_leader: false dest_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" is_pre_election: true
I20260429 08:00:36.978368 2648 raft_consensus.cc:2410] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd076a6196ef424a813003c9c5d53d42 for term 5 because replica has last-logged OpId of term: 3 index: 87, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 76.
I20260429 08:00:36.978693 2479 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42; no voters: d7c20d1745e54a9db1e0082a48ed06e4, f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:36.978848 2706 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260429 08:00:37.627792 2714 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:37.627905 2714 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:37.628418 2714 leader_election.cc:290] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
I20260429 08:00:37.628942 2502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" candidate_term: 5 candidate_status { last_received { term: 3 index: 87 } } ignore_live_leader: false dest_uuid: "cd076a6196ef424a813003c9c5d53d42" is_pre_election: true
I20260429 08:00:37.629156 2502 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7c20d1745e54a9db1e0082a48ed06e4 in term 4.
I20260429 08:00:37.629525 2625 leader_election.cc:304] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4; no voters:
I20260429 08:00:37.629743 2714 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260429 08:00:37.629827 2714 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260429 08:00:37.629858 2622 leader_election.cc:336] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:37.629912 2714 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 4 FOLLOWER]: Advancing to term 5
I20260429 08:00:37.630785 2714 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:37.631105 2714 leader_election.cc:290] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 5 election: Requested vote from peers f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
I20260429 08:00:37.631460 2502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" candidate_term: 5 candidate_status { last_received { term: 3 index: 87 } } ignore_live_leader: false dest_uuid: "cd076a6196ef424a813003c9c5d53d42"
I20260429 08:00:37.631604 2502 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 4 FOLLOWER]: Advancing to term 5
W20260429 08:00:37.631955 2622 leader_election.cc:336] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:37.632467 2502 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7c20d1745e54a9db1e0082a48ed06e4 in term 5.
I20260429 08:00:37.632768 2625 leader_election.cc:304] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4; no voters: f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:37.632954 2714 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 5 FOLLOWER]: Leader election won for term 5
I20260429 08:00:37.633190 2714 raft_consensus.cc:697] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 5 LEADER]: Becoming Leader. State: Replica: d7c20d1745e54a9db1e0082a48ed06e4, State: Running, Role: LEADER
I20260429 08:00:37.633500 2714 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 3.87, Last appended by leader: 87, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:37.635149 2717 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7c20d1745e54a9db1e0082a48ed06e4. Latest consensus state: current_term: 5 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:37.635257 2717 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:37.635557 2719 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260429 08:00:37.637142 2719 catalog_manager.cc:679] Loaded metadata for table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]
I20260429 08:00:37.637429 2719 catalog_manager.cc:679] Loaded metadata for table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e]
I20260429 08:00:37.637682 2719 catalog_manager.cc:679] Loaded metadata for table default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8]
I20260429 08:00:37.637909 2719 catalog_manager.cc:679] Loaded metadata for table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]
I20260429 08:00:37.638132 2719 catalog_manager.cc:679] Loaded metadata for table default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156]
I20260429 08:00:37.638348 2719 catalog_manager.cc:679] Loaded metadata for table default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1]
I20260429 08:00:37.638582 2719 catalog_manager.cc:679] Loaded metadata for table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]
I20260429 08:00:37.638798 2719 catalog_manager.cc:679] Loaded metadata for table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]
I20260429 08:00:37.638995 2719 catalog_manager.cc:679] Loaded metadata for table default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3]
I20260429 08:00:37.639185 2719 catalog_manager.cc:679] Loaded metadata for table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]
I20260429 08:00:37.639381 2719 catalog_manager.cc:679] Loaded metadata for table default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b]
I20260429 08:00:37.639578 2719 catalog_manager.cc:679] Loaded metadata for table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]
I20260429 08:00:37.639786 2719 catalog_manager.cc:679] Loaded metadata for table default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b]
I20260429 08:00:37.640061 2719 catalog_manager.cc:679] Loaded metadata for table default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5]
I20260429 08:00:37.641288 2719 tablet_loader.cc:96] loaded metadata for tablet 29d7fe3ebc3148a9be321460da8abdb5 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08])
I20260429 08:00:37.641628 2719 tablet_loader.cc:96] loaded metadata for tablet 3b29c11f78624a22922bae3070f194f3 (table default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1])
I20260429 08:00:37.641813 2719 tablet_loader.cc:96] loaded metadata for tablet 3d4069c79e8f4c36ba414169bd049b8f (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91])
I20260429 08:00:37.642033 2719 tablet_loader.cc:96] loaded metadata for tablet 43def4d831db44c09e060f4949e6f8ac (table default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b])
I20260429 08:00:37.642241 2719 tablet_loader.cc:96] loaded metadata for tablet 50ab0c1c41f54389a6fd480da7026f20 (table default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b])
I20260429 08:00:37.642521 2719 tablet_loader.cc:96] loaded metadata for tablet 5a2349526fb740f4b9c964cb9ecef4d6 (table default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5])
I20260429 08:00:37.642824 2719 tablet_loader.cc:96] loaded metadata for tablet 6fed5cc1d4c045408c1b3342e8baba02 (table default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8])
I20260429 08:00:37.643033 2719 tablet_loader.cc:96] loaded metadata for tablet 81c91c679c114775bd302d89f0996393 (table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47])
I20260429 08:00:37.643225 2719 tablet_loader.cc:96] loaded metadata for tablet 881e1249f58b4480ad5940e69ee49788 (table default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3])
I20260429 08:00:37.643484 2719 tablet_loader.cc:96] loaded metadata for tablet 93630bad9fdd46e9b982cd1b44665433 (table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e])
I20260429 08:00:37.643860 2719 tablet_loader.cc:96] loaded metadata for tablet c1c2987616df4a438b5160e1fbc5387e (table default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156])
I20260429 08:00:37.644068 2719 tablet_loader.cc:96] loaded metadata for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07])
I20260429 08:00:37.644340 2719 tablet_loader.cc:96] loaded metadata for tablet d1ee8252269e41e3bbe96fa3a43d4d9e (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2])
I20260429 08:00:37.644526 2719 tablet_loader.cc:96] loaded metadata for tablet e2cfe56e4eca41c0b8ce2f3210f035ea (table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006])
I20260429 08:00:37.644767 2719 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260429 08:00:37.645238 2719 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:37.645300 2719 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260429 08:00:37.645951 2719 catalog_manager.cc:1514] Loading token signing keys...
I20260429 08:00:37.646450 2719 catalog_manager.cc:6055] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Loaded TSK: 0
I20260429 08:00:37.647029 2719 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260429 08:00:37.647508 2719 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260429 08:00:37.647892 2719 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 20
I20260429 08:00:37.685038 2637 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_a3cf45aaf37c4ddf9ed00173d7c72a4c" } modify_external_catalogs: true
I20260429 08:00:37.685209 2637 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_a3cf45aaf37c4ddf9ed00173d7c72a4c" } modify_external_catalogs: true
I20260429 08:00:37.685552 2636 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_ec6b6e2df1d545c78484235081b96327" } modify_external_catalogs: true
I20260429 08:00:37.685586 2638 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_00c8e8b0543b48458c08b780734269c6" } new_table_name: "default.Table_1bb6d84b6ef5474eb7270ecbd2c1af77" modify_external_catalogs: true
I20260429 08:00:37.685674 2636 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_ec6b6e2df1d545c78484235081b96327" } modify_external_catalogs: true
I20260429 08:00:37.686057 2635 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51456:
name: "default.Table_b1938a0ba6d9429ba63271d6f958a060"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:37.686259 2630 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_2aa9e902a68149cebca957e279cc82c4" } modify_external_catalogs: true
I20260429 08:00:37.686350 2630 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_2aa9e902a68149cebca957e279cc82c4" } modify_external_catalogs: true
I20260429 08:00:37.686475 2632 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_6795420cac01458198a3bf0876fd6092" } new_table_name: "default.Table_7d633f7b157e487daf0b0a993a8a71bc" modify_external_catalogs: true
I20260429 08:00:37.686501 2631 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_99b9b733ad5c4a149389412905245938" } new_table_name: "default.Table_e2b4380a107742eab4f7945356ff2a2b" modify_external_catalogs: true
I20260429 08:00:37.686662 2633 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_34261e3d16e14d888f3f3fd3c436b4ad" } modify_external_catalogs: true
I20260429 08:00:37.686739 2633 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_34261e3d16e14d888f3f3fd3c436b4ad" } modify_external_catalogs: true
I20260429 08:00:37.686702 2629 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_91fe24cd92b444e1bd97440b6e584816" } new_table_name: "default.Table_85410940ba1345d08dcf40344274439a" modify_external_catalogs: true
I20260429 08:00:37.686859 2634 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_03bb29fc9f854e85b7fc52f6523c6db0" } modify_external_catalogs: true
I20260429 08:00:37.686920 2634 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51456:
table { table_name: "default.Table_03bb29fc9f854e85b7fc52f6523c6db0" } modify_external_catalogs: true
F20260429 08:00:37.691649 2693 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 23, previous 23; dumping first 4 out of 13 received events: NotificationEvent(eventId=21, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_207de250815e4c1793355de8d028abec, message={"server":"","servicePrincipal":"","db":"default","table":"table_207de250815e4c1793355de8d028abec","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_207de250815e4c1793355de8d028abec\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_207de250815e4c1793355de8d028abec\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_207de250815e4c1793355de8d028abec\",\"kudu.table_id\":\"76db81fc69b8490d98c0496a830d00c2\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1777449632, eventType=CREATE_TABLE, dbName=default, tableName=table_91fe24cd92b444e1bd97440b6e584816, message={"server":"","servicePrincipal":"","db":"default","table":"table_91fe24cd92b444e1bd97440b6e584816","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_91fe24cd92b444e1bd97440b6e584816\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449632},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_91fe24cd92b444e1bd97440b6e584816\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_91fe24cd92b444e1bd97440b6e584816\",\"kudu.table_id\":\"85f2230320084f08a7b147f7efd77ed1\",\"transient_lastDdlTime\":\"1777449632\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_34261e3d16e14d888f3f3fd3c436b4ad, message={"server":"","servicePrincipal":"","db":"default","table":"table_34261e3d16e14d888f3f3fd3c436b4ad","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449630},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_34261e3d16e14d888f3f3fd3c436b4ad\",\"kudu.table_id\":\"ba5133c5668141589469ba6e26f75c47\",\"transient_lastDdlTime\":\"1777449630\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_012320bc4c054b62be2e415bca912daf, message={"server":"","servicePrincipal":"","db":"default","table":"table_012320bc4c054b62be2e415bca912daf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_012320bc4c054b62be2e415bca912daf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_012320bc4c054b62be2e415bca912daf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_012320bc4c054b62be2e415bca912daf\",\"kudu.table_id\":\"038ee5f1404b4d3ca452c21bfa0253e6\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f25d7245dcd google::LogMessage::Fail() at ??:0
@ 0x7f25d7249b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f25d72457cc google::LogMessage::Flush() at ??:0
@ 0x7f25d7245a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7f25dc7b9433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f25dc7b834a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f25dc7b7aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
@ 0x7f25dc7bd1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x564f57975244 std::function<>::operator()() at ??:0
@ 0x7f25d874a7ea kudu::Thread::SuperviseThread() at ??:0
@ 0x7f25d908f6db start_thread at ??:0
@ 0x7f25d63fc61f clone at ??:0
W20260429 08:00:37.861523 2061 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.14.62:41885)
W20260429 08:00:37.861907 2061 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.1.14.62:41885)
W20260429 08:00:37.862058 2061 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.1.14.62:41885)
W20260429 08:00:37.862442 2061 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.1.14.62:41885)
I20260429 08:00:38.254227 2453 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:00:38.254338 2453 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:39.400617 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.62:41885
--webserver_interface=127.1.14.62
--webserver_port=35601
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260429 08:00:39.497983 2739 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:39.498142 2739 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:39.498206 2739 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:39.501140 2739 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 08:00:39.501183 2739 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:39.501201 2739 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 08:00:39.501258 2739 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 08:00:39.505086 2739 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.62:41885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.14.62
--webserver_port=35601
--never_fsync=true
--heap_profile_path=/tmp/kudu.2739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:39.505859 2739 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:39.506770 2739 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:39.511653 2745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:39.511667 2747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:39.511732 2744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:39.511884 2739 server_base.cc:1061] running on GCE node
I20260429 08:00:39.512450 2739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:39.513229 2739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:39.514370 2739 hybrid_clock.cc:648] HybridClock initialized: now 1777449639514355 us; error 26 us; skew 500 ppm
I20260429 08:00:39.515842 2739 webserver.cc:492] Webserver started at http://127.1.14.62:35601/ using document root <none> and password file <none>
I20260429 08:00:39.516279 2739 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:39.516323 2739 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:39.519022 2739 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:39.520605 2753 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:39.521442 2739 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:39.521551 2739 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
uuid: "d7c20d1745e54a9db1e0082a48ed06e4"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:39.521879 2739 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:39.534338 2739 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:39.534803 2739 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:39.534972 2739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:39.541541 2739 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.62:41885
I20260429 08:00:39.541550 2805 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.62:41885 every 8 connection(s)
I20260429 08:00:39.542755 2739 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/info.pb
I20260429 08:00:39.545660 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 2739
I20260429 08:00:39.546188 2806 sys_catalog.cc:263] Verifying existing consensus state
I20260429 08:00:39.548046 2806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Bootstrap starting.
I20260429 08:00:39.558118 2806 log.cc:826] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:39.598867 2806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=88 overwritten=0 applied=87 ignored=0} inserts{seen=53 ignored=0} mutations{seen=73 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260429 08:00:39.599196 2806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Bootstrap complete.
I20260429 08:00:39.601425 2806 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 5 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:39.601810 2806 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7c20d1745e54a9db1e0082a48ed06e4, State: Initialized, Role: FOLLOWER
I20260429 08:00:39.602185 2806 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 87, Last appended: 5.88, Last appended by leader: 88, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:39.602540 2810 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:39.602670 2810 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:39.603127 2806 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260429 08:00:39.608484 2824 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:39.608611 2824 catalog_manager.cc:1562] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: loading cluster ID for follower catalog manager: success
I20260429 08:00:39.610889 2824 catalog_manager.cc:1584] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: acquiring CA information for follower catalog manager: success
I20260429 08:00:39.613550 2824 catalog_manager.cc:1612] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260429 08:00:39.614254 2739 master_runner.cc:186] Error getting master registration for 127.1.14.61:33847: Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111),
I20260429 08:00:39.615952 2739 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:39.652798 1778 heartbeater.cc:344] Connected to a master server at 127.1.14.62:41885
I20260429 08:00:39.654428 2770 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6441a846e67a46159cef1413b6d06337" instance_seqno: 1777449628680786) as {username='slave'} at 127.1.14.1:44937; Asking this server to re-register.
I20260429 08:00:39.654871 1778 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:39.656059 2770 ts_manager.cc:194] Registered new tserver with Master: 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:39.961081 2052 heartbeater.cc:344] Connected to a master server at 127.1.14.62:41885
I20260429 08:00:39.961915 2770 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" instance_seqno: 1777449629023571) as {username='slave'} at 127.1.14.3:48929; Asking this server to re-register.
I20260429 08:00:39.962363 2052 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:39.963251 2770 ts_manager.cc:194] Registered new tserver with Master: 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:40.042889 1916 heartbeater.cc:344] Connected to a master server at 127.1.14.62:41885
I20260429 08:00:40.043123 2810 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:40.043295 2810 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:40.043848 2770 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "353e59f343974ee68738535fb9029d30" instance_seqno: 1777449628847581) as {username='slave'} at 127.1.14.2:54667; Asking this server to re-register.
I20260429 08:00:40.044200 1916 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:40.044590 2810 leader_election.cc:290] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:40.045186 2754 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:40.045292 2770 ts_manager.cc:194] Registered new tserver with Master: 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:00:40.046074 2754 leader_election.cc:336] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:40.048141 2502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" candidate_term: 6 candidate_status { last_received { term: 5 index: 88 } } ignore_live_leader: false dest_uuid: "cd076a6196ef424a813003c9c5d53d42" is_pre_election: true
I20260429 08:00:40.048262 2502 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7c20d1745e54a9db1e0082a48ed06e4 in term 5.
I20260429 08:00:40.048538 2757 leader_election.cc:304] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4; no voters: f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:40.048794 2810 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260429 08:00:40.048861 2810 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:40.048899 2810 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 5 FOLLOWER]: Advancing to term 6
I20260429 08:00:40.050421 2810 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:40.050699 2810 leader_election.cc:290] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 6 election: Requested vote from peers f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
I20260429 08:00:40.051049 2502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" candidate_term: 6 candidate_status { last_received { term: 5 index: 88 } } ignore_live_leader: false dest_uuid: "cd076a6196ef424a813003c9c5d53d42"
I20260429 08:00:40.051170 2502 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 5 FOLLOWER]: Advancing to term 6
W20260429 08:00:40.051534 2754 leader_election.cc:336] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:40.052058 2502 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7c20d1745e54a9db1e0082a48ed06e4 in term 6.
I20260429 08:00:40.052318 2757 leader_election.cc:304] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4; no voters: f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:40.052466 2810 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 6 FOLLOWER]: Leader election won for term 6
I20260429 08:00:40.052692 2810 raft_consensus.cc:697] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 6 LEADER]: Becoming Leader. State: Replica: d7c20d1745e54a9db1e0082a48ed06e4, State: Running, Role: LEADER
I20260429 08:00:40.052977 2810 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 5.88, Last appended by leader: 88, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:40.054378 2832 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7c20d1745e54a9db1e0082a48ed06e4. Latest consensus state: current_term: 6 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:40.054452 2832 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:40.054692 2834 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260429 08:00:40.056104 2834 catalog_manager.cc:679] Loaded metadata for table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]
I20260429 08:00:40.056310 2834 catalog_manager.cc:679] Loaded metadata for table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e]
I20260429 08:00:40.056519 2834 catalog_manager.cc:679] Loaded metadata for table default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8]
I20260429 08:00:40.056813 2834 catalog_manager.cc:679] Loaded metadata for table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]
I20260429 08:00:40.057042 2834 catalog_manager.cc:679] Loaded metadata for table default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156]
I20260429 08:00:40.057199 2834 catalog_manager.cc:679] Loaded metadata for table default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1]
I20260429 08:00:40.057338 2834 catalog_manager.cc:679] Loaded metadata for table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]
I20260429 08:00:40.057479 2834 catalog_manager.cc:679] Loaded metadata for table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]
I20260429 08:00:40.057611 2834 catalog_manager.cc:679] Loaded metadata for table default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3]
I20260429 08:00:40.057742 2834 catalog_manager.cc:679] Loaded metadata for table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]
I20260429 08:00:40.057875 2834 catalog_manager.cc:679] Loaded metadata for table default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b]
I20260429 08:00:40.058015 2834 catalog_manager.cc:679] Loaded metadata for table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]
I20260429 08:00:40.058146 2834 catalog_manager.cc:679] Loaded metadata for table default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b]
I20260429 08:00:40.058435 2834 catalog_manager.cc:679] Loaded metadata for table default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5]
I20260429 08:00:40.059726 2834 tablet_loader.cc:96] loaded metadata for tablet 29d7fe3ebc3148a9be321460da8abdb5 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08])
I20260429 08:00:40.060052 2834 tablet_loader.cc:96] loaded metadata for tablet 3b29c11f78624a22922bae3070f194f3 (table default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1])
I20260429 08:00:40.060238 2834 tablet_loader.cc:96] loaded metadata for tablet 3d4069c79e8f4c36ba414169bd049b8f (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91])
I20260429 08:00:40.060407 2834 tablet_loader.cc:96] loaded metadata for tablet 43def4d831db44c09e060f4949e6f8ac (table default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b])
I20260429 08:00:40.060606 2834 tablet_loader.cc:96] loaded metadata for tablet 50ab0c1c41f54389a6fd480da7026f20 (table default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b])
I20260429 08:00:40.060868 2834 tablet_loader.cc:96] loaded metadata for tablet 5a2349526fb740f4b9c964cb9ecef4d6 (table default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5])
I20260429 08:00:40.061112 2834 tablet_loader.cc:96] loaded metadata for tablet 6fed5cc1d4c045408c1b3342e8baba02 (table default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8])
I20260429 08:00:40.061273 2834 tablet_loader.cc:96] loaded metadata for tablet 81c91c679c114775bd302d89f0996393 (table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47])
I20260429 08:00:40.061434 2834 tablet_loader.cc:96] loaded metadata for tablet 881e1249f58b4480ad5940e69ee49788 (table default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3])
I20260429 08:00:40.061678 2834 tablet_loader.cc:96] loaded metadata for tablet 93630bad9fdd46e9b982cd1b44665433 (table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e])
I20260429 08:00:40.062037 2834 tablet_loader.cc:96] loaded metadata for tablet c1c2987616df4a438b5160e1fbc5387e (table default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156])
I20260429 08:00:40.062219 2834 tablet_loader.cc:96] loaded metadata for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07])
I20260429 08:00:40.062477 2834 tablet_loader.cc:96] loaded metadata for tablet d1ee8252269e41e3bbe96fa3a43d4d9e (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2])
I20260429 08:00:40.062650 2834 tablet_loader.cc:96] loaded metadata for tablet e2cfe56e4eca41c0b8ce2f3210f035ea (table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006])
I20260429 08:00:40.062872 2834 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260429 08:00:40.063360 2834 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:40.063405 2834 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260429 08:00:40.063942 2834 catalog_manager.cc:1514] Loading token signing keys...
I20260429 08:00:40.064378 2834 catalog_manager.cc:6055] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Loaded TSK: 0
I20260429 08:00:40.064942 2834 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260429 08:00:40.065387 2834 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260429 08:00:40.065948 2834 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 20
I20260429 08:00:40.074116 2767 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51964:
name: "default.Table_baf66e1ed64348eda0d85f89019f9f49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:40.074286 2765 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51964:
name: "default.Table_1f3eaa53e74241cc830474cdcc774f87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:40.074506 2764 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51964:
name: "default.Table_7d22f9579cdc49118b40da3544eeee0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:40.074600 2762 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51964:
name: "default.Table_012320bc4c054b62be2e415bca912daf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:40.074031 2768 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51964:
name: "default.Table_e71df0e290ff44a1b6d66b910af211c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:40.074661 2761 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51964:
table { table_name: "default.Table_34261e3d16e14d888f3f3fd3c436b4ad" } modify_external_catalogs: true
I20260429 08:00:40.074783 2761 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51964:
table { table_name: "default.Table_34261e3d16e14d888f3f3fd3c436b4ad" } modify_external_catalogs: true
I20260429 08:00:40.074801 2770 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51964:
name: "default.Table_ba60f2d687a9431288851fb68b310758"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:40.074875 2766 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51964:
name: "default.Table_cc83324222db4bf980b1244fe6100d93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:40.073993 2769 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51964:
name: "default.Table_eec10405ada64deba7b1528381398882"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:40.074985 2763 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51964:
table { table_name: "default.Table_3b6223798dcd434c989986f1d5727b55" } new_table_name: "default.Table_2cdd9567b5794d2f89bd56027f9fe823" modify_external_catalogs: true
F20260429 08:00:40.079133 2823 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 23, previous 23; dumping first 4 out of 13 received events: NotificationEvent(eventId=21, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_207de250815e4c1793355de8d028abec, message={"server":"","servicePrincipal":"","db":"default","table":"table_207de250815e4c1793355de8d028abec","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_207de250815e4c1793355de8d028abec\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_207de250815e4c1793355de8d028abec\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_207de250815e4c1793355de8d028abec\",\"kudu.table_id\":\"76db81fc69b8490d98c0496a830d00c2\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1777449632, eventType=CREATE_TABLE, dbName=default, tableName=table_91fe24cd92b444e1bd97440b6e584816, message={"server":"","servicePrincipal":"","db":"default","table":"table_91fe24cd92b444e1bd97440b6e584816","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_91fe24cd92b444e1bd97440b6e584816\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449632},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_91fe24cd92b444e1bd97440b6e584816\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_91fe24cd92b444e1bd97440b6e584816\",\"kudu.table_id\":\"85f2230320084f08a7b147f7efd77ed1\",\"transient_lastDdlTime\":\"1777449632\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_34261e3d16e14d888f3f3fd3c436b4ad, message={"server":"","servicePrincipal":"","db":"default","table":"table_34261e3d16e14d888f3f3fd3c436b4ad","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449630},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_34261e3d16e14d888f3f3fd3c436b4ad\",\"kudu.table_id\":\"ba5133c5668141589469ba6e26f75c47\",\"transient_lastDdlTime\":\"1777449630\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_012320bc4c054b62be2e415bca912daf, message={"server":"","servicePrincipal":"","db":"default","table":"table_012320bc4c054b62be2e415bca912daf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_012320bc4c054b62be2e415bca912daf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_012320bc4c054b62be2e415bca912daf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_012320bc4c054b62be2e415bca912daf\",\"kudu.table_id\":\"038ee5f1404b4d3ca452c21bfa0253e6\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7ff7ded61dcd google::LogMessage::Fail() at ??:0
@ 0x7ff7ded65b93 google::LogMessage::SendToLog() at ??:0
@ 0x7ff7ded617cc google::LogMessage::Flush() at ??:0
@ 0x7ff7ded61a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7ff7e42d5433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7ff7e42d434a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7ff7e42d3aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
@ 0x7ff7e42d91b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x559228be8244 std::function<>::operator()() at ??:0
@ 0x7ff7e02667ea kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff7e0bab6db start_thread at ??:0
@ 0x7ff7ddf1861f clone at ??:0
W20260429 08:00:40.241648 1667 connection.cc:570] client connection to 127.1.14.62:41885 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:40.242452 2061 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.14.62:41885)
W20260429 08:00:40.242619 2061 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.1.14.62:41885)
W20260429 08:00:40.242872 2061 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.1.14.62:41885)
W20260429 08:00:40.242949 2061 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.1.14.62:41885)
I20260429 08:00:42.432056 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.62:41885
--webserver_interface=127.1.14.62
--webserver_port=35601
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260429 08:00:42.534535 2851 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:42.534750 2851 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:42.534835 2851 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:42.538059 2851 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 08:00:42.538137 2851 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:42.538173 2851 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 08:00:42.538231 2851 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 08:00:42.541885 2851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.62:41885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.14.62
--webserver_port=35601
--never_fsync=true
--heap_profile_path=/tmp/kudu.2851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:42.542855 2851 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:42.543929 2851 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:42.549335 2856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:42.549583 2857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:42.549921 2851 server_base.cc:1061] running on GCE node
W20260429 08:00:42.550220 2859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:42.550776 2851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:42.551577 2851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:42.552749 2851 hybrid_clock.cc:648] HybridClock initialized: now 1777449642552730 us; error 32 us; skew 500 ppm
I20260429 08:00:42.554411 2851 webserver.cc:492] Webserver started at http://127.1.14.62:35601/ using document root <none> and password file <none>
I20260429 08:00:42.554929 2851 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:42.555015 2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:42.557971 2851 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260429 08:00:42.559720 2865 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:42.560737 2851 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:42.560838 2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
uuid: "d7c20d1745e54a9db1e0082a48ed06e4"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:42.561149 2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:42.591040 2851 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:42.591704 2851 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:42.591879 2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:42.599153 2851 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.62:41885
I20260429 08:00:42.599164 2917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.62:41885 every 8 connection(s)
I20260429 08:00:42.600127 2851 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-0/data/info.pb
I20260429 08:00:42.603710 2918 sys_catalog.cc:263] Verifying existing consensus state
I20260429 08:00:42.605278 2918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Bootstrap starting.
I20260429 08:00:42.607759 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 2851
I20260429 08:00:42.615633 2918 log.cc:826] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:42.657366 2918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Bootstrap replayed 1/1 log segments. Stats: ops{read=89 overwritten=0 applied=87 ignored=0} inserts{seen=53 ignored=0} mutations{seen=73 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260429 08:00:42.657882 2918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Bootstrap complete.
I20260429 08:00:42.661528 2918 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 6 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:42.662112 2918 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7c20d1745e54a9db1e0082a48ed06e4, State: Initialized, Role: FOLLOWER
I20260429 08:00:42.662551 2918 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 87, Last appended: 6.89, Last appended by leader: 89, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:42.662974 2922 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:42.663075 2922 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:42.663571 2918 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260429 08:00:42.669759 2936 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:42.669823 2936 catalog_manager.cc:1562] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: loading cluster ID for follower catalog manager: success
I20260429 08:00:42.671715 2936 catalog_manager.cc:1584] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: acquiring CA information for follower catalog manager: success
I20260429 08:00:42.672915 2936 catalog_manager.cc:1612] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260429 08:00:42.684423 2851 master_runner.cc:186] Error getting master registration for 127.1.14.61:33847: Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111),
I20260429 08:00:42.685889 2851 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:42.749351 1778 heartbeater.cc:344] Connected to a master server at 127.1.14.62:41885
I20260429 08:00:42.751178 2882 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6441a846e67a46159cef1413b6d06337" instance_seqno: 1777449628680786) as {username='slave'} at 127.1.14.1:48169; Asking this server to re-register.
I20260429 08:00:42.751663 1778 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:42.753028 2882 ts_manager.cc:194] Registered new tserver with Master: 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:42.934527 2941 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:42.934666 2941 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:42.935036 2941 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
W20260429 08:00:42.935647 2476 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260429 08:00:42.936371 2476 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:42.938858 2892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd076a6196ef424a813003c9c5d53d42" candidate_term: 7 candidate_status { last_received { term: 3 index: 76 } } ignore_live_leader: false dest_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" is_pre_election: true
I20260429 08:00:42.939157 2892 raft_consensus.cc:2410] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd076a6196ef424a813003c9c5d53d42 for term 7 because replica has last-logged OpId of term: 6 index: 89, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 76.
I20260429 08:00:42.939498 2479 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42; no voters: d7c20d1745e54a9db1e0082a48ed06e4, f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:42.939692 2941 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260429 08:00:42.970976 2052 heartbeater.cc:344] Connected to a master server at 127.1.14.62:41885
I20260429 08:00:42.972153 2882 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" instance_seqno: 1777449629023571) as {username='slave'} at 127.1.14.3:56031; Asking this server to re-register.
I20260429 08:00:42.972654 2052 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:42.973507 2882 ts_manager.cc:194] Registered new tserver with Master: 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:43.054141 1916 heartbeater.cc:344] Connected to a master server at 127.1.14.62:41885
I20260429 08:00:43.055105 2882 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "353e59f343974ee68738535fb9029d30" instance_seqno: 1777449628847581) as {username='slave'} at 127.1.14.2:45335; Asking this server to re-register.
I20260429 08:00:43.055555 1916 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:43.056478 2882 ts_manager.cc:194] Registered new tserver with Master: 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:43.181602 2945 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:43.181810 2945 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:43.182977 2945 leader_election.cc:290] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:43.183429 2866 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
W20260429 08:00:43.184603 2866 leader_election.cc:336] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:43.186492 2502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" candidate_term: 7 candidate_status { last_received { term: 6 index: 89 } } ignore_live_leader: false dest_uuid: "cd076a6196ef424a813003c9c5d53d42" is_pre_election: true
I20260429 08:00:43.186674 2502 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7c20d1745e54a9db1e0082a48ed06e4 in term 6.
I20260429 08:00:43.187037 2869 leader_election.cc:304] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4; no voters: f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:43.187253 2945 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260429 08:00:43.187321 2945 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:43.187408 2945 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 6 FOLLOWER]: Advancing to term 7
I20260429 08:00:43.189289 2945 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:43.189669 2945 leader_election.cc:290] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 7 election: Requested vote from peers f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
I20260429 08:00:43.190009 2502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" candidate_term: 7 candidate_status { last_received { term: 6 index: 89 } } ignore_live_leader: false dest_uuid: "cd076a6196ef424a813003c9c5d53d42"
I20260429 08:00:43.190132 2502 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 6 FOLLOWER]: Advancing to term 7
W20260429 08:00:43.190523 2866 leader_election.cc:336] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:43.191360 2502 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7c20d1745e54a9db1e0082a48ed06e4 in term 7.
I20260429 08:00:43.191715 2869 leader_election.cc:304] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4; no voters: f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:43.191910 2945 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 7 FOLLOWER]: Leader election won for term 7
I20260429 08:00:43.192102 2945 raft_consensus.cc:697] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [term 7 LEADER]: Becoming Leader. State: Replica: d7c20d1745e54a9db1e0082a48ed06e4, State: Running, Role: LEADER
I20260429 08:00:43.192387 2945 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 6.89, Last appended by leader: 89, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:43.194063 2949 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7c20d1745e54a9db1e0082a48ed06e4. Latest consensus state: current_term: 7 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:43.194172 2949 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:43.194478 2951 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260429 08:00:43.196154 2951 catalog_manager.cc:679] Loaded metadata for table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]
I20260429 08:00:43.196378 2951 catalog_manager.cc:679] Loaded metadata for table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e]
I20260429 08:00:43.196643 2951 catalog_manager.cc:679] Loaded metadata for table default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8]
I20260429 08:00:43.196858 2951 catalog_manager.cc:679] Loaded metadata for table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]
I20260429 08:00:43.197016 2951 catalog_manager.cc:679] Loaded metadata for table default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156]
I20260429 08:00:43.197168 2951 catalog_manager.cc:679] Loaded metadata for table default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1]
I20260429 08:00:43.197336 2951 catalog_manager.cc:679] Loaded metadata for table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]
I20260429 08:00:43.197520 2951 catalog_manager.cc:679] Loaded metadata for table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]
I20260429 08:00:43.197687 2951 catalog_manager.cc:679] Loaded metadata for table default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3]
I20260429 08:00:43.197842 2951 catalog_manager.cc:679] Loaded metadata for table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]
I20260429 08:00:43.198005 2951 catalog_manager.cc:679] Loaded metadata for table default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b]
I20260429 08:00:43.198161 2951 catalog_manager.cc:679] Loaded metadata for table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]
I20260429 08:00:43.198311 2951 catalog_manager.cc:679] Loaded metadata for table default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b]
I20260429 08:00:43.198547 2951 catalog_manager.cc:679] Loaded metadata for table default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5]
I20260429 08:00:43.199791 2951 tablet_loader.cc:96] loaded metadata for tablet 29d7fe3ebc3148a9be321460da8abdb5 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08])
I20260429 08:00:43.200115 2951 tablet_loader.cc:96] loaded metadata for tablet 3b29c11f78624a22922bae3070f194f3 (table default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1])
I20260429 08:00:43.200248 2951 tablet_loader.cc:96] loaded metadata for tablet 3d4069c79e8f4c36ba414169bd049b8f (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91])
I20260429 08:00:43.200372 2951 tablet_loader.cc:96] loaded metadata for tablet 43def4d831db44c09e060f4949e6f8ac (table default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b])
I20260429 08:00:43.200495 2951 tablet_loader.cc:96] loaded metadata for tablet 50ab0c1c41f54389a6fd480da7026f20 (table default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b])
I20260429 08:00:43.200786 2951 tablet_loader.cc:96] loaded metadata for tablet 5a2349526fb740f4b9c964cb9ecef4d6 (table default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5])
I20260429 08:00:43.201030 2951 tablet_loader.cc:96] loaded metadata for tablet 6fed5cc1d4c045408c1b3342e8baba02 (table default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8])
I20260429 08:00:43.201179 2951 tablet_loader.cc:96] loaded metadata for tablet 81c91c679c114775bd302d89f0996393 (table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47])
I20260429 08:00:43.201313 2951 tablet_loader.cc:96] loaded metadata for tablet 881e1249f58b4480ad5940e69ee49788 (table default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3])
I20260429 08:00:43.201625 2951 tablet_loader.cc:96] loaded metadata for tablet 93630bad9fdd46e9b982cd1b44665433 (table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e])
I20260429 08:00:43.202068 2951 tablet_loader.cc:96] loaded metadata for tablet c1c2987616df4a438b5160e1fbc5387e (table default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156])
I20260429 08:00:43.202258 2951 tablet_loader.cc:96] loaded metadata for tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07])
I20260429 08:00:43.202564 2951 tablet_loader.cc:96] loaded metadata for tablet d1ee8252269e41e3bbe96fa3a43d4d9e (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2])
I20260429 08:00:43.202754 2951 tablet_loader.cc:96] loaded metadata for tablet e2cfe56e4eca41c0b8ce2f3210f035ea (table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006])
I20260429 08:00:43.202992 2951 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260429 08:00:43.203466 2951 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:43.203533 2951 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260429 08:00:43.204157 2951 catalog_manager.cc:1514] Loading token signing keys...
I20260429 08:00:43.204687 2951 catalog_manager.cc:6055] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Loaded TSK: 0
I20260429 08:00:43.205207 2951 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260429 08:00:43.205799 2951 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260429 08:00:43.206292 2951 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 20
I20260429 08:00:43.256408 2881 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56138:
name: "default.Table_207de250815e4c1793355de8d028abec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:43.256758 2879 master_service.cc:954] ReplaceTablet: received request to replace tablet e2cfe56e4eca41c0b8ce2f3210f035ea from {username='slave'} at 127.0.0.1:56138
I20260429 08:00:43.256932 2875 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56138:
table { table_name: "default.Table_99b9b733ad5c4a149389412905245938" } new_table_name: "default.Table_e2b4380a107742eab4f7945356ff2a2b" modify_external_catalogs: true
I20260429 08:00:43.257141 2882 master_service.cc:954] ReplaceTablet: received request to replace tablet d1ee8252269e41e3bbe96fa3a43d4d9e from {username='slave'} at 127.0.0.1:56138
I20260429 08:00:43.257587 2880 master_service.cc:954] ReplaceTablet: received request to replace tablet c7bc3a1e6a8f4060b9c4132297e04f2f from {username='slave'} at 127.0.0.1:56138
I20260429 08:00:43.258466 2874 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56138:
table { table_name: "default.Table_91fe24cd92b444e1bd97440b6e584816" } new_table_name: "default.Table_85410940ba1345d08dcf40344274439a" modify_external_catalogs: true
I20260429 08:00:43.258766 2878 master_service.cc:954] ReplaceTablet: received request to replace tablet d1ee8252269e41e3bbe96fa3a43d4d9e from {username='slave'} at 127.0.0.1:56138
I20260429 08:00:43.258940 2877 master_service.cc:954] ReplaceTablet: received request to replace tablet 81c91c679c114775bd302d89f0996393 from {username='slave'} at 127.0.0.1:56138
I20260429 08:00:43.259588 2876 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56138:
table { table_name: "default.Table_2aa9e902a68149cebca957e279cc82c4" } modify_external_catalogs: true
I20260429 08:00:43.259719 2876 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56138:
table { table_name: "default.Table_2aa9e902a68149cebca957e279cc82c4" } modify_external_catalogs: true
I20260429 08:00:43.259912 2873 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56138:
name: "default.Table_1f3eaa53e74241cc830474cdcc774f87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:43.260763 2502 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Refusing update from remote peer d7c20d1745e54a9db1e0082a48ed06e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 76. Preceding OpId from leader: term: 7 index: 91. (index mismatch)
I20260429 08:00:43.261461 2949 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 76, Time since last communication: 0.000s
I20260429 08:00:43.262825 2453 master_runner.cc:186] Error getting master registration for 127.1.14.61:33847: Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111),
I20260429 08:00:43.262931 2453 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260429 08:00:43.262953 2866 consensus_peers.cc:597] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 -> Peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Couldn't send request to peer f1e6af049ae04c6e98cb5e609f9be472. Status: Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260429 08:00:43.263264 2935 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 23, previous 23; dumping first 4 out of 13 received events: NotificationEvent(eventId=21, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_207de250815e4c1793355de8d028abec, message={"server":"","servicePrincipal":"","db":"default","table":"table_207de250815e4c1793355de8d028abec","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_207de250815e4c1793355de8d028abec\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_207de250815e4c1793355de8d028abec\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_207de250815e4c1793355de8d028abec\",\"kudu.table_id\":\"76db81fc69b8490d98c0496a830d00c2\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1777449632, eventType=CREATE_TABLE, dbName=default, tableName=table_91fe24cd92b444e1bd97440b6e584816, message={"server":"","servicePrincipal":"","db":"default","table":"table_91fe24cd92b444e1bd97440b6e584816","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_91fe24cd92b444e1bd97440b6e584816\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449632},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_91fe24cd92b444e1bd97440b6e584816\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_91fe24cd92b444e1bd97440b6e584816\",\"kudu.table_id\":\"85f2230320084f08a7b147f7efd77ed1\",\"transient_lastDdlTime\":\"1777449632\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_34261e3d16e14d888f3f3fd3c436b4ad, message={"server":"","servicePrincipal":"","db":"default","table":"table_34261e3d16e14d888f3f3fd3c436b4ad","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449630},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_34261e3d16e14d888f3f3fd3c436b4ad\",\"kudu.table_id\":\"ba5133c5668141589469ba6e26f75c47\",\"transient_lastDdlTime\":\"1777449630\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_012320bc4c054b62be2e415bca912daf, message={"server":"","servicePrincipal":"","db":"default","table":"table_012320bc4c054b62be2e415bca912daf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_012320bc4c054b62be2e415bca912daf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_012320bc4c054b62be2e415bca912daf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_012320bc4c054b62be2e415bca912daf\",\"kudu.table_id\":\"038ee5f1404b4d3ca452c21bfa0253e6\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f3136fa5dcd google::LogMessage::Fail() at ??:0
@ 0x7f3136fa9b93 google::LogMessage::SendToLog() at ??:0
I20260429 08:00:43.269279 2941 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7c20d1745e54a9db1e0082a48ed06e4. Latest consensus state: current_term: 7 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:43.269398 2941 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f3136fa57cc google::LogMessage::Flush() at ??:0
I20260429 08:00:43.271458 2945 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:43.271555 2945 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:43.271696 2945 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:43.271770 2945 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:43.271848 2952 mvcc.cc:204] Tried to move back new op lower bound from 7280433738792767488 to 7280433715749208064. Current Snapshot: MvccSnapshot[applied={T|T < 7280433738790219776}]
I20260429 08:00:43.272369 2949 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:43.272456 2949 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4 [sys.catalog]: This master's current role is: LEADER
@ 0x7f3136fa5a11 google::LogMessage::~LogMessage() at ??:0
I20260429 08:00:43.274050 2941 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:43.274161 2941 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:43.274255 2941 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:43.274338 2941 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:43.274411 2941 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:43.274484 2941 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:43.274601 2953 mvcc.cc:204] Tried to move back new op lower bound from 7280433738792767488 to 7280433715749208064. Current Snapshot: MvccSnapshot[applied={T|T < 7280433694816145408}]
I20260429 08:00:43.276304 2879 catalog_manager.cc:5958] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Sending DeleteTablet for 3 replicas of tablet e2cfe56e4eca41c0b8ce2f3210f035ea
I20260429 08:00:43.277354 2877 catalog_manager.cc:5958] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Sending DeleteTablet for 3 replicas of tablet 81c91c679c114775bd302d89f0996393
I20260429 08:00:43.277859 2882 catalog_manager.cc:5958] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Sending DeleteTablet for 3 replicas of tablet d1ee8252269e41e3bbe96fa3a43d4d9e
I20260429 08:00:43.278277 2878 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56138:
name: "default.Table_cc83324222db4bf980b1244fe6100d93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:43.279134 2879 catalog_manager.cc:6741] ReplaceTablet: tablet e2cfe56e4eca41c0b8ce2f3210f035ea deleted and replaced by tablet 4279160d7f8446109052951d62dcde1d
I20260429 08:00:43.279156 2882 catalog_manager.cc:6741] ReplaceTablet: tablet d1ee8252269e41e3bbe96fa3a43d4d9e deleted and replaced by tablet aefbf6a8d8b14de6965475a82ba5c9c4
I20260429 08:00:43.279371 2879 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56138:
name: "default.Table_baf66e1ed64348eda0d85f89019f9f49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:43.279394 2882 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56138:
name: "default.Table_e71df0e290ff44a1b6d66b910af211c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7f313c519433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260429 08:00:43.281109 2877 catalog_manager.cc:6741] ReplaceTablet: tablet 81c91c679c114775bd302d89f0996393 deleted and replaced by tablet 0c763b359f5542888013123b2037b5d0
I20260429 08:00:43.281298 2877 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56138:
name: "default.Table_ba60f2d687a9431288851fb68b310758"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:43.283299 2880 catalog_manager.cc:5958] T 00000000000000000000000000000000 P d7c20d1745e54a9db1e0082a48ed06e4: Sending DeleteTablet for 3 replicas of tablet c7bc3a1e6a8f4060b9c4132297e04f2f
I20260429 08:00:43.283564 2880 catalog_manager.cc:6741] ReplaceTablet: tablet c7bc3a1e6a8f4060b9c4132297e04f2f deleted and replaced by tablet 9622269e5988486a87b443646bf894cf
I20260429 08:00:43.283828 2880 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56138:
name: "default.Table_eec10405ada64deba7b1528381398882"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:43.284102 1707 tablet_service.cc:1558] Processing DeleteTablet for tablet e2cfe56e4eca41c0b8ce2f3210f035ea with delete_type TABLET_DATA_DELETED (replaced by tablet 4279160d7f8446109052951d62dcde1d) from {username='slave'} at 127.0.0.1:34090
@ 0x7f313c51834a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260429 08:00:43.284368 1705 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c91c679c114775bd302d89f0996393 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c763b359f5542888013123b2037b5d0) from {username='slave'} at 127.0.0.1:34090
I20260429 08:00:43.284488 1706 tablet_service.cc:1558] Processing DeleteTablet for tablet d1ee8252269e41e3bbe96fa3a43d4d9e with delete_type TABLET_DATA_DELETED (replaced by tablet aefbf6a8d8b14de6965475a82ba5c9c4) from {username='slave'} at 127.0.0.1:34090
I20260429 08:00:43.284641 1710 tablet_service.cc:1558] Processing DeleteTablet for tablet c7bc3a1e6a8f4060b9c4132297e04f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 9622269e5988486a87b443646bf894cf) from {username='slave'} at 127.0.0.1:34090
I20260429 08:00:43.286034 1844 tablet_service.cc:1558] Processing DeleteTablet for tablet d1ee8252269e41e3bbe96fa3a43d4d9e with delete_type TABLET_DATA_DELETED (replaced by tablet aefbf6a8d8b14de6965475a82ba5c9c4) from {username='slave'} at 127.0.0.1:36480
I20260429 08:00:43.286077 1846 tablet_service.cc:1558] Processing DeleteTablet for tablet e2cfe56e4eca41c0b8ce2f3210f035ea with delete_type TABLET_DATA_DELETED (replaced by tablet 4279160d7f8446109052951d62dcde1d) from {username='slave'} at 127.0.0.1:36480
I20260429 08:00:43.286183 1845 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c91c679c114775bd302d89f0996393 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c763b359f5542888013123b2037b5d0) from {username='slave'} at 127.0.0.1:36480
I20260429 08:00:43.286336 1847 tablet_service.cc:1558] Processing DeleteTablet for tablet c7bc3a1e6a8f4060b9c4132297e04f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 9622269e5988486a87b443646bf894cf) from {username='slave'} at 127.0.0.1:36480
@ 0x7f313c517aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260429 08:00:43.288352 1710 tablet_service.cc:1511] Processing CreateTablet for tablet aefbf6a8d8b14de6965475a82ba5c9c4 (DEFAULT_TABLE table=default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:43.288702 1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aefbf6a8d8b14de6965475a82ba5c9c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:43.291064 1847 tablet_service.cc:1511] Processing CreateTablet for tablet aefbf6a8d8b14de6965475a82ba5c9c4 (DEFAULT_TABLE table=default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:43.291074 2974 tablet_replica.cc:333] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:43.291320 2974 raft_consensus.cc:2243] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:43.291324 1847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aefbf6a8d8b14de6965475a82ba5c9c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:43.291803 2974 raft_consensus.cc:2272] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:43.292342 1983 tablet_service.cc:1558] Processing DeleteTablet for tablet e2cfe56e4eca41c0b8ce2f3210f035ea with delete_type TABLET_DATA_DELETED (replaced by tablet 4279160d7f8446109052951d62dcde1d) from {username='slave'} at 127.0.0.1:47296
I20260429 08:00:43.293072 1985 tablet_service.cc:1558] Processing DeleteTablet for tablet d1ee8252269e41e3bbe96fa3a43d4d9e with delete_type TABLET_DATA_DELETED (replaced by tablet aefbf6a8d8b14de6965475a82ba5c9c4) from {username='slave'} at 127.0.0.1:47296
I20260429 08:00:43.293192 1984 tablet_service.cc:1558] Processing DeleteTablet for tablet c7bc3a1e6a8f4060b9c4132297e04f2f with delete_type TABLET_DATA_DELETED (replaced by tablet 9622269e5988486a87b443646bf894cf) from {username='slave'} at 127.0.0.1:47296
I20260429 08:00:43.293464 1982 tablet_service.cc:1511] Processing CreateTablet for tablet aefbf6a8d8b14de6965475a82ba5c9c4 (DEFAULT_TABLE table=default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7f313c51d1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260429 08:00:43.293718 1982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aefbf6a8d8b14de6965475a82ba5c9c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:43.294929 2974 ts_tablet_manager.cc:1916] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:43.295197 1847 tablet_service.cc:1511] Processing CreateTablet for tablet 4279160d7f8446109052951d62dcde1d (DEFAULT_TABLE table=default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:43.295378 1847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4279160d7f8446109052951d62dcde1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:43.296046 1984 tablet_service.cc:1511] Processing CreateTablet for tablet 4279160d7f8446109052951d62dcde1d (DEFAULT_TABLE table=default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:43.296183 1846 tablet_service.cc:1511] Processing CreateTablet for tablet 0c763b359f5542888013123b2037b5d0 (DEFAULT_TABLE table=default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:43.296286 1984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4279160d7f8446109052951d62dcde1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:43.296437 1846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c763b359f5542888013123b2037b5d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:43.298550 1710 tablet_service.cc:1511] Processing CreateTablet for tablet 4279160d7f8446109052951d62dcde1d (DEFAULT_TABLE table=default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:43.298743 1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4279160d7f8446109052951d62dcde1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:43.298518 1706 tablet_service.cc:1511] Processing CreateTablet for tablet 0c763b359f5542888013123b2037b5d0 (DEFAULT_TABLE table=default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:43.298938 1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c763b359f5542888013123b2037b5d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:43.299234 2974 ts_tablet_manager.cc:1929] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:43.299292 2974 log.cc:1199] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/d1ee8252269e41e3bbe96fa3a43d4d9e
I20260429 08:00:43.299541 2974 ts_tablet_manager.cc:1950] T d1ee8252269e41e3bbe96fa3a43d4d9e P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
@ 0x55c9de1b6244 std::function<>::operator()() at ??:0
I20260429 08:00:43.300266 2973 tablet_replica.cc:333] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:43.300439 2973 raft_consensus.cc:2243] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:43.300650 2973 raft_consensus.cc:2272] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:43.300643 1983 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c91c679c114775bd302d89f0996393 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c763b359f5542888013123b2037b5d0) from {username='slave'} at 127.0.0.1:47296
I20260429 08:00:43.301046 2973 ts_tablet_manager.cc:1916] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:43.302227 1982 tablet_service.cc:1511] Processing CreateTablet for tablet 0c763b359f5542888013123b2037b5d0 (DEFAULT_TABLE table=default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:43.302438 1982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c763b359f5542888013123b2037b5d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:43.303725 1983 tablet_service.cc:1511] Processing CreateTablet for tablet 9622269e5988486a87b443646bf894cf (DEFAULT_TABLE table=default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:43.303920 1983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9622269e5988486a87b443646bf894cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:43.304080 1846 tablet_service.cc:1511] Processing CreateTablet for tablet 9622269e5988486a87b443646bf894cf (DEFAULT_TABLE table=default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:43.304311 1846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9622269e5988486a87b443646bf894cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:43.304956 1706 tablet_service.cc:1511] Processing CreateTablet for tablet 9622269e5988486a87b443646bf894cf (DEFAULT_TABLE table=default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:43.306123 2977 tablet_bootstrap.cc:492] T aefbf6a8d8b14de6965475a82ba5c9c4 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:43.306422 1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9622269e5988486a87b443646bf894cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:43.306762 2974 tablet_replica.cc:333] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:43.306885 2974 raft_consensus.cc:2243] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:43.306968 2974 raft_consensus.cc:2272] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:43.307296 2974 ts_tablet_manager.cc:1916] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:43.307834 2868 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet d1ee8252269e41e3bbe96fa3a43d4d9e (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]) successfully deleted
I20260429 08:00:43.307991 2973 ts_tablet_manager.cc:1929] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:43.308050 2973 log.cc:1199] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/e2cfe56e4eca41c0b8ce2f3210f035ea
I20260429 08:00:43.308300 2973 ts_tablet_manager.cc:1950] T e2cfe56e4eca41c0b8ce2f3210f035ea P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
@ 0x7f31384aa7ea kudu::Thread::SuperviseThread() at ??:0
I20260429 08:00:43.308929 2974 ts_tablet_manager.cc:1929] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:43.308987 2974 log.cc:1199] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/81c91c679c114775bd302d89f0996393
I20260429 08:00:43.309228 2974 ts_tablet_manager.cc:1950] T 81c91c679c114775bd302d89f0996393 P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:43.309742 2974 tablet_replica.cc:333] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:43.309767 2977 tablet_bootstrap.cc:654] T aefbf6a8d8b14de6965475a82ba5c9c4 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:43.309762 2868 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet 81c91c679c114775bd302d89f0996393 (table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]) successfully deleted
I20260429 08:00:43.309845 2974 raft_consensus.cc:2243] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:43.309948 2975 tablet_replica.cc:333] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:43.309947 2974 raft_consensus.cc:2272] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:43.310051 2975 raft_consensus.cc:2243] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:43.310132 2975 raft_consensus.cc:2272] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:43.310267 2974 ts_tablet_manager.cc:1916] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:43.310365 2975 ts_tablet_manager.cc:1916] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:43.310436 2978 tablet_bootstrap.cc:492] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:43.311515 2978 tablet_bootstrap.cc:654] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:43.311980 2974 ts_tablet_manager.cc:1929] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:43.312047 2974 log.cc:1199] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/e2cfe56e4eca41c0b8ce2f3210f035ea
I20260429 08:00:43.312162 2975 ts_tablet_manager.cc:1929] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:43.312209 2975 log.cc:1199] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/e2cfe56e4eca41c0b8ce2f3210f035ea
I20260429 08:00:43.312299 2974 ts_tablet_manager.cc:1950] T e2cfe56e4eca41c0b8ce2f3210f035ea P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:43.312417 2975 ts_tablet_manager.cc:1950] T e2cfe56e4eca41c0b8ce2f3210f035ea P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:43.312784 2976 tablet_bootstrap.cc:492] T aefbf6a8d8b14de6965475a82ba5c9c4 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:43.312963 2868 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet e2cfe56e4eca41c0b8ce2f3210f035ea (table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]) successfully deleted
I20260429 08:00:43.313004 2974 tablet_replica.cc:333] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:43.313110 2974 raft_consensus.cc:2243] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:43.313117 2869 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet e2cfe56e4eca41c0b8ce2f3210f035ea (table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]) successfully deleted
I20260429 08:00:43.313211 2974 raft_consensus.cc:2272] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:43.313230 2867 catalog_manager.cc:5002] TS 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): tablet e2cfe56e4eca41c0b8ce2f3210f035ea (table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]) successfully deleted
I20260429 08:00:43.313308 2975 tablet_replica.cc:333] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:43.313407 2973 tablet_replica.cc:333] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:43.313428 2975 raft_consensus.cc:2243] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:43.313517 2974 ts_tablet_manager.cc:1916] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:43.313512 2973 raft_consensus.cc:2243] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:43.313535 2975 raft_consensus.cc:2272] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:43.313623 2973 raft_consensus.cc:2272] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:43.313905 2975 ts_tablet_manager.cc:1916] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:43.313947 2973 ts_tablet_manager.cc:1916] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f3138def6db start_thread at ??:0
I20260429 08:00:43.315332 2974 ts_tablet_manager.cc:1929] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:43.315394 2974 log.cc:1199] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/c7bc3a1e6a8f4060b9c4132297e04f2f
I20260429 08:00:43.315624 2974 ts_tablet_manager.cc:1950] T c7bc3a1e6a8f4060b9c4132297e04f2f P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:43.315889 2975 ts_tablet_manager.cc:1929] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:43.315964 2975 log.cc:1199] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/d1ee8252269e41e3bbe96fa3a43d4d9e
I20260429 08:00:43.316213 2975 ts_tablet_manager.cc:1950] T d1ee8252269e41e3bbe96fa3a43d4d9e P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:43.316285 2868 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet c7bc3a1e6a8f4060b9c4132297e04f2f (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]) successfully deleted
I20260429 08:00:43.316694 2976 tablet_bootstrap.cc:654] T aefbf6a8d8b14de6965475a82ba5c9c4 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:43.316859 2978 tablet_bootstrap.cc:492] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:43.316987 2869 catalog_manager.cc:5002] TS 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): tablet d1ee8252269e41e3bbe96fa3a43d4d9e (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]) successfully deleted
I20260429 08:00:43.317013 2978 ts_tablet_manager.cc:1403] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260429 08:00:43.317166 2975 tablet_replica.cc:333] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:43.317283 2975 raft_consensus.cc:2243] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:43.317355 2973 ts_tablet_manager.cc:1929] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:43.317397 2975 raft_consensus.cc:2272] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:43.317415 2973 log.cc:1199] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/81c91c679c114775bd302d89f0996393
I20260429 08:00:43.317632 2973 ts_tablet_manager.cc:1950] T 81c91c679c114775bd302d89f0996393 P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:43.317694 2977 tablet_bootstrap.cc:492] T aefbf6a8d8b14de6965475a82ba5c9c4 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:43.317713 2975 ts_tablet_manager.cc:1916] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:43.317760 2977 ts_tablet_manager.cc:1403] T aefbf6a8d8b14de6965475a82ba5c9c4 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
@ 0x7f313615c61f clone at ??:0
I20260429 08:00:43.318125 2973 tablet_replica.cc:333] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:43.318495 2973 raft_consensus.cc:2243] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:43.318604 2973 raft_consensus.cc:2272] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:43.318877 2977 raft_consensus.cc:359] T aefbf6a8d8b14de6965475a82ba5c9c4 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:43.318957 2977 raft_consensus.cc:385] T aefbf6a8d8b14de6965475a82ba5c9c4 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:43.318975 2977 raft_consensus.cc:740] T aefbf6a8d8b14de6965475a82ba5c9c4 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:43.319022 2973 ts_tablet_manager.cc:1916] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:43.319126 2977 consensus_queue.cc:260] T aefbf6a8d8b14de6965475a82ba5c9c4 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:43.319407 1778 heartbeater.cc:499] Master 127.1.14.62:41885 was elected leader, sending a full tablet report...
I20260429 08:00:43.319656 2978 raft_consensus.cc:359] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:43.319764 2978 raft_consensus.cc:385] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:43.319794 2978 raft_consensus.cc:740] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:43.319850 2975 ts_tablet_manager.cc:1929] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:43.319959 2975 log.cc:1199] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/c7bc3a1e6a8f4060b9c4132297e04f2f
I20260429 08:00:43.319913 2978 consensus_queue.cc:260] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:43.320176 2978 ts_tablet_manager.cc:1434] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260429 08:00:43.320188 2975 ts_tablet_manager.cc:1950] T c7bc3a1e6a8f4060b9c4132297e04f2f P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:43.319427 2977 ts_tablet_manager.cc:1434] T aefbf6a8d8b14de6965475a82ba5c9c4 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:43.320410 2977 tablet_bootstrap.cc:492] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:43.321302 2977 tablet_bootstrap.cc:654] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:43.321868 2973 ts_tablet_manager.cc:1929] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:43.321930 2973 log.cc:1199] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/d1ee8252269e41e3bbe96fa3a43d4d9e
I20260429 08:00:43.322150 2973 ts_tablet_manager.cc:1950] T d1ee8252269e41e3bbe96fa3a43d4d9e P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:43.322669 2973 tablet_replica.cc:333] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:43.322769 2973 raft_consensus.cc:2243] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:43.322907 2973 raft_consensus.cc:2272] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:43.323217 2973 ts_tablet_manager.cc:1916] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:43.323361 2978 tablet_bootstrap.cc:492] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:43.324707 2978 tablet_bootstrap.cc:654] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:43.324745 2973 ts_tablet_manager.cc:1929] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:43.324791 2973 log.cc:1199] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/c7bc3a1e6a8f4060b9c4132297e04f2f
I20260429 08:00:43.325002 2973 ts_tablet_manager.cc:1950] T c7bc3a1e6a8f4060b9c4132297e04f2f P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:43.325646 2975 tablet_replica.cc:333] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a: stopping tablet replica
I20260429 08:00:43.325733 2976 tablet_bootstrap.cc:492] T aefbf6a8d8b14de6965475a82ba5c9c4 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:43.325757 2975 raft_consensus.cc:2243] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:43.325811 2976 ts_tablet_manager.cc:1403] T aefbf6a8d8b14de6965475a82ba5c9c4 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20260429 08:00:43.325947 2975 raft_consensus.cc:2272] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:43.326232 2975 ts_tablet_manager.cc:1916] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:43.326239 2976 raft_consensus.cc:359] T aefbf6a8d8b14de6965475a82ba5c9c4 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:43.326325 2976 raft_consensus.cc:385] T aefbf6a8d8b14de6965475a82ba5c9c4 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:43.326355 2976 raft_consensus.cc:740] T aefbf6a8d8b14de6965475a82ba5c9c4 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:43.326474 2976 consensus_queue.cc:260] T aefbf6a8d8b14de6965475a82ba5c9c4 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:43.326722 2976 ts_tablet_manager.cc:1434] T aefbf6a8d8b14de6965475a82ba5c9c4 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:43.328071 2975 ts_tablet_manager.cc:1929] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:43.328135 2975 log.cc:1199] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-2/wal/wals/81c91c679c114775bd302d89f0996393
I20260429 08:00:43.328346 2975 ts_tablet_manager.cc:1950] T 81c91c679c114775bd302d89f0996393 P 873f2b4fab6f42738b2d41b4608a592a: Deleting consensus metadata
I20260429 08:00:43.329145 2978 tablet_bootstrap.cc:492] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:43.329210 2978 ts_tablet_manager.cc:1403] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260429 08:00:43.329308 2976 tablet_bootstrap.cc:492] T 4279160d7f8446109052951d62dcde1d P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:43.329629 2978 raft_consensus.cc:359] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.329728 2978 raft_consensus.cc:385] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:43.329763 2978 raft_consensus.cc:740] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:43.330030 2978 consensus_queue.cc:260] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.330349 2976 tablet_bootstrap.cc:654] T 4279160d7f8446109052951d62dcde1d P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:43.331952 2978 ts_tablet_manager.cc:1434] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260429 08:00:43.333377 2977 tablet_bootstrap.cc:492] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:43.333436 2977 ts_tablet_manager.cc:1403] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20260429 08:00:43.333482 2978 tablet_bootstrap.cc:492] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:43.333770 2977 raft_consensus.cc:359] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.333834 2977 raft_consensus.cc:385] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:43.333853 2977 raft_consensus.cc:740] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:43.333938 2977 consensus_queue.cc:260] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.334103 2977 ts_tablet_manager.cc:1434] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:43.334206 2977 tablet_bootstrap.cc:492] T 4279160d7f8446109052951d62dcde1d P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:43.334882 2977 tablet_bootstrap.cc:654] T 4279160d7f8446109052951d62dcde1d P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:43.336043 2977 tablet_bootstrap.cc:492] T 4279160d7f8446109052951d62dcde1d P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:43.336087 2978 tablet_bootstrap.cc:654] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:43.336107 2977 ts_tablet_manager.cc:1403] T 4279160d7f8446109052951d62dcde1d P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:43.336623 2977 raft_consensus.cc:359] T 4279160d7f8446109052951d62dcde1d P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.336721 2977 raft_consensus.cc:385] T 4279160d7f8446109052951d62dcde1d P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:43.336752 2977 raft_consensus.cc:740] T 4279160d7f8446109052951d62dcde1d P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:43.336890 2977 consensus_queue.cc:260] T 4279160d7f8446109052951d62dcde1d P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.337131 2977 ts_tablet_manager.cc:1434] T 4279160d7f8446109052951d62dcde1d P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:43.337266 2977 tablet_bootstrap.cc:492] T 9622269e5988486a87b443646bf894cf P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:43.337944 2977 tablet_bootstrap.cc:654] T 9622269e5988486a87b443646bf894cf P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:43.338719 2977 tablet_bootstrap.cc:492] T 9622269e5988486a87b443646bf894cf P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:43.338768 2977 ts_tablet_manager.cc:1403] T 9622269e5988486a87b443646bf894cf P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:43.339121 2977 raft_consensus.cc:359] T 9622269e5988486a87b443646bf894cf P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.339177 2977 raft_consensus.cc:385] T 9622269e5988486a87b443646bf894cf P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:43.339195 2977 raft_consensus.cc:740] T 9622269e5988486a87b443646bf894cf P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:43.339299 2977 consensus_queue.cc:260] T 9622269e5988486a87b443646bf894cf P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.339527 2977 ts_tablet_manager.cc:1434] T 9622269e5988486a87b443646bf894cf P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:43.341058 2978 tablet_bootstrap.cc:492] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:43.341130 2978 ts_tablet_manager.cc:1403] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260429 08:00:43.341545 2978 raft_consensus.cc:359] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.341640 2978 raft_consensus.cc:385] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:43.341782 2978 raft_consensus.cc:740] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:43.341928 2978 consensus_queue.cc:260] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.343077 2978 ts_tablet_manager.cc:1434] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:43.343708 2978 tablet_bootstrap.cc:492] T 0c763b359f5542888013123b2037b5d0 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:43.344691 2978 tablet_bootstrap.cc:654] T 0c763b359f5542888013123b2037b5d0 P 873f2b4fab6f42738b2d41b4608a592a: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:43.345182 2976 tablet_bootstrap.cc:492] T 4279160d7f8446109052951d62dcde1d P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:43.345261 2976 ts_tablet_manager.cc:1403] T 4279160d7f8446109052951d62dcde1d P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.001s
I20260429 08:00:43.345650 2976 raft_consensus.cc:359] T 4279160d7f8446109052951d62dcde1d P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.345747 2976 raft_consensus.cc:385] T 4279160d7f8446109052951d62dcde1d P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:43.345788 2976 raft_consensus.cc:740] T 4279160d7f8446109052951d62dcde1d P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:43.345819 2978 tablet_bootstrap.cc:492] T 0c763b359f5542888013123b2037b5d0 P 873f2b4fab6f42738b2d41b4608a592a: No bootstrap required, opened a new log
I20260429 08:00:43.345929 2978 ts_tablet_manager.cc:1403] T 0c763b359f5542888013123b2037b5d0 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260429 08:00:43.345925 2976 consensus_queue.cc:260] T 4279160d7f8446109052951d62dcde1d P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.346194 2976 ts_tablet_manager.cc:1434] T 4279160d7f8446109052951d62dcde1d P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:43.346369 2976 tablet_bootstrap.cc:492] T 0c763b359f5542888013123b2037b5d0 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:43.346383 2978 raft_consensus.cc:359] T 0c763b359f5542888013123b2037b5d0 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.346480 2978 raft_consensus.cc:385] T 0c763b359f5542888013123b2037b5d0 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:43.347568 2976 tablet_bootstrap.cc:654] T 0c763b359f5542888013123b2037b5d0 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:43.347538 2978 raft_consensus.cc:740] T 0c763b359f5542888013123b2037b5d0 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:43.347734 2978 consensus_queue.cc:260] T 0c763b359f5542888013123b2037b5d0 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.348905 2260 raft_consensus.cc:493] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:43.348984 2260 raft_consensus.cc:515] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.349347 2260 leader_election.cc:290] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:43.349594 2976 tablet_bootstrap.cc:492] T 0c763b359f5542888013123b2037b5d0 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:43.349648 2976 ts_tablet_manager.cc:1403] T 0c763b359f5542888013123b2037b5d0 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260429 08:00:43.350034 2976 raft_consensus.cc:359] T 0c763b359f5542888013123b2037b5d0 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.350127 2976 raft_consensus.cc:385] T 0c763b359f5542888013123b2037b5d0 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:43.350162 2976 raft_consensus.cc:740] T 0c763b359f5542888013123b2037b5d0 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:43.350255 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c763b359f5542888013123b2037b5d0" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a" is_pre_election: true
I20260429 08:00:43.350268 2976 consensus_queue.cc:260] T 0c763b359f5542888013123b2037b5d0 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.350349 2004 raft_consensus.cc:2468] T 0c763b359f5542888013123b2037b5d0 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:43.350515 2976 ts_tablet_manager.cc:1434] T 0c763b359f5542888013123b2037b5d0 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:43.350646 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c763b359f5542888013123b2037b5d0" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:43.350795 1867 raft_consensus.cc:2468] T 0c763b359f5542888013123b2037b5d0 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:43.350859 1667 leader_election.cc:304] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:43.351465 2976 tablet_bootstrap.cc:492] T 9622269e5988486a87b443646bf894cf P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:43.352367 2976 tablet_bootstrap.cc:654] T 9622269e5988486a87b443646bf894cf P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:43.352607 2260 raft_consensus.cc:2804] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:43.352665 2260 raft_consensus.cc:493] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:43.352712 2260 raft_consensus.cc:3060] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:43.353682 2260 raft_consensus.cc:515] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.354035 2260 leader_election.cc:290] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Requested vote from peers 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:43.354324 2004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c763b359f5542888013123b2037b5d0" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "873f2b4fab6f42738b2d41b4608a592a"
I20260429 08:00:43.354424 2004 raft_consensus.cc:3060] T 0c763b359f5542888013123b2037b5d0 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:43.354496 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c763b359f5542888013123b2037b5d0" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:43.354585 1867 raft_consensus.cc:3060] T 0c763b359f5542888013123b2037b5d0 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:43.354641 2978 ts_tablet_manager.cc:1434] T 0c763b359f5542888013123b2037b5d0 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20260429 08:00:43.355335 2004 raft_consensus.cc:2468] T 0c763b359f5542888013123b2037b5d0 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:43.355504 1867 raft_consensus.cc:2468] T 0c763b359f5542888013123b2037b5d0 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:43.355665 1667 leader_election.cc:304] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:43.355885 2260 raft_consensus.cc:2804] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:43.356077 2260 raft_consensus.cc:697] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Becoming Leader. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Running, Role: LEADER
I20260429 08:00:43.356202 2260 consensus_queue.cc:237] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.358403 2976 tablet_bootstrap.cc:492] T 9622269e5988486a87b443646bf894cf P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:43.358481 2976 ts_tablet_manager.cc:1403] T 9622269e5988486a87b443646bf894cf P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260429 08:00:43.359009 2976 raft_consensus.cc:359] T 9622269e5988486a87b443646bf894cf P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.359110 2976 raft_consensus.cc:385] T 9622269e5988486a87b443646bf894cf P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:43.359144 2976 raft_consensus.cc:740] T 9622269e5988486a87b443646bf894cf P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:43.359269 2976 consensus_queue.cc:260] T 9622269e5988486a87b443646bf894cf P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.359586 2976 ts_tablet_manager.cc:1434] T 9622269e5988486a87b443646bf894cf P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20260429 08:00:43.491426 1939 connection.cc:570] server connection from 127.0.0.1:47296 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:43.491516 1665 connection.cc:570] server connection from 127.0.0.1:34090 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:43.491652 1805 connection.cc:570] client connection to 127.1.14.62:41885 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:43.491685 1940 connection.cc:570] client connection to 127.1.14.62:41885 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:43.492089 1667 connection.cc:570] client connection to 127.1.14.62:41885 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:43.493360 2735 negotiation.cc:336] Failed RPC negotiation. Trace:
0429 08:00:43.492552 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.1.14.62:41885 (local address 127.1.14.3:59537)
0429 08:00:43.492766 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0429 08:00:43.492814 (+ 48us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":136}
W20260429 08:00:43.493366 2713 negotiation.cc:336] Failed RPC negotiation. Trace:
0429 08:00:43.492250 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.1.14.62:41885 (local address 127.1.14.2:53367)
0429 08:00:43.492404 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0429 08:00:43.492421 (+ 17us) client_negotiation.cc:175] Beginning negotiation
0429 08:00:43.492510 (+ 89us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0429 08:00:43.492954 (+ 444us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":53}
W20260429 08:00:43.493525 2061 connection.cc:570] client connection to 127.1.14.62:41885 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:43.493901 2061 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.1.14.62:41885)
W20260429 08:00:43.494216 2061 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.1.14.62:41885)
W20260429 08:00:43.494345 2061 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.1.14.62:41885)
W20260429 08:00:43.494542 2061 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.14.62:41885)
I20260429 08:00:43.500656 2940 raft_consensus.cc:493] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:43.500742 2940 raft_consensus.cc:515] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.501156 2940 leader_election.cc:290] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:43.501415 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4279160d7f8446109052951d62dcde1d" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:43.501444 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4279160d7f8446109052951d62dcde1d" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:43.501518 1729 raft_consensus.cc:2468] T 4279160d7f8446109052951d62dcde1d P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:43.501571 1867 raft_consensus.cc:2468] T 4279160d7f8446109052951d62dcde1d P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:43.501844 1938 leader_election.cc:304] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:43.502002 2940 raft_consensus.cc:2804] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:43.502055 2940 raft_consensus.cc:493] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:43.502103 2940 raft_consensus.cc:3060] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:43.502879 2940 raft_consensus.cc:515] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.503238 2940 leader_election.cc:290] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:43.503496 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4279160d7f8446109052951d62dcde1d" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:43.503583 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4279160d7f8446109052951d62dcde1d" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:43.503628 1729 raft_consensus.cc:3060] T 4279160d7f8446109052951d62dcde1d P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:43.503715 1867 raft_consensus.cc:3060] T 4279160d7f8446109052951d62dcde1d P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:43.504376 1729 raft_consensus.cc:2468] T 4279160d7f8446109052951d62dcde1d P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:43.504436 1867 raft_consensus.cc:2468] T 4279160d7f8446109052951d62dcde1d P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:43.504707 1938 leader_election.cc:304] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:43.504880 2940 raft_consensus.cc:2804] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:43.505081 2940 raft_consensus.cc:697] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [term 1 LEADER]: Becoming Leader. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Running, Role: LEADER
I20260429 08:00:43.505218 2940 consensus_queue.cc:237] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.553004 2940 raft_consensus.cc:493] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:43.553123 2940 raft_consensus.cc:515] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:43.553712 2940 leader_election.cc:290] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:43.553817 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefbf6a8d8b14de6965475a82ba5c9c4" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:43.553951 1867 raft_consensus.cc:2468] T aefbf6a8d8b14de6965475a82ba5c9c4 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:43.554117 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefbf6a8d8b14de6965475a82ba5c9c4" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:43.554224 1939 leader_election.cc:304] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:43.554280 1729 raft_consensus.cc:2468] T aefbf6a8d8b14de6965475a82ba5c9c4 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:43.554415 2940 raft_consensus.cc:2804] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:43.554491 2940 raft_consensus.cc:493] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:43.554534 2940 raft_consensus.cc:3060] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:43.555358 2940 raft_consensus.cc:515] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:43.555646 2940 leader_election.cc:290] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Requested vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:43.555997 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefbf6a8d8b14de6965475a82ba5c9c4" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:43.556111 1867 raft_consensus.cc:3060] T aefbf6a8d8b14de6965475a82ba5c9c4 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:43.556149 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aefbf6a8d8b14de6965475a82ba5c9c4" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:43.556288 1729 raft_consensus.cc:3060] T aefbf6a8d8b14de6965475a82ba5c9c4 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:43.556921 1867 raft_consensus.cc:2468] T aefbf6a8d8b14de6965475a82ba5c9c4 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:43.557116 1729 raft_consensus.cc:2468] T aefbf6a8d8b14de6965475a82ba5c9c4 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:43.557235 1939 leader_election.cc:304] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:43.557451 2940 raft_consensus.cc:2804] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:43.557565 2940 raft_consensus.cc:697] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [term 1 LEADER]: Becoming Leader. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Running, Role: LEADER
I20260429 08:00:43.557713 2940 consensus_queue.cc:237] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:43.586429 2940 raft_consensus.cc:493] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:43.586512 2940 raft_consensus.cc:515] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.586911 2940 leader_election.cc:290] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:43.587318 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9622269e5988486a87b443646bf894cf" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:43.587319 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9622269e5988486a87b443646bf894cf" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:43.587445 1867 raft_consensus.cc:2468] T 9622269e5988486a87b443646bf894cf P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:43.587459 1729 raft_consensus.cc:2468] T 9622269e5988486a87b443646bf894cf P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 0.
I20260429 08:00:43.587694 1939 leader_election.cc:304] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:43.587844 2940 raft_consensus.cc:2804] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:43.587899 2940 raft_consensus.cc:493] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:43.587935 2940 raft_consensus.cc:3060] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:43.588524 2940 raft_consensus.cc:515] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.588840 2940 leader_election.cc:290] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Requested vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:43.589107 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9622269e5988486a87b443646bf894cf" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:43.589107 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9622269e5988486a87b443646bf894cf" candidate_uuid: "873f2b4fab6f42738b2d41b4608a592a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:43.589208 1867 raft_consensus.cc:3060] T 9622269e5988486a87b443646bf894cf P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:43.589218 1729 raft_consensus.cc:3060] T 9622269e5988486a87b443646bf894cf P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:43.590097 1867 raft_consensus.cc:2468] T 9622269e5988486a87b443646bf894cf P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:43.590097 1729 raft_consensus.cc:2468] T 9622269e5988486a87b443646bf894cf P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 873f2b4fab6f42738b2d41b4608a592a in term 1.
I20260429 08:00:43.590370 1939 leader_election.cc:304] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a; no voters:
I20260429 08:00:43.590528 2940 raft_consensus.cc:2804] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:43.590618 2940 raft_consensus.cc:697] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [term 1 LEADER]: Becoming Leader. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Running, Role: LEADER
I20260429 08:00:43.590845 2940 consensus_queue.cc:237] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } }
I20260429 08:00:43.806344 3009 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d7c20d1745e54a9db1e0082a48ed06e4)
I20260429 08:00:43.806452 3009 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:43.807240 3009 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
W20260429 08:00:43.807865 2479 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:43.808040 2476 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:43.808127 2476 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42; no voters: d7c20d1745e54a9db1e0082a48ed06e4, f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:43.808279 3009 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260429 08:00:43.881031 2260 consensus_queue.cc:1048] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:43.885161 3017 consensus_queue.cc:1048] T 0c763b359f5542888013123b2037b5d0 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:43.954346 2940 consensus_queue.cc:1048] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:43.957711 2940 consensus_queue.cc:1048] T aefbf6a8d8b14de6965475a82ba5c9c4 P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:43.990321 2940 consensus_queue.cc:1048] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:43.993204 3023 consensus_queue.cc:1048] T 9622269e5988486a87b443646bf894cf P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:44.048311 3023 consensus_queue.cc:1048] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:44.051321 3004 consensus_queue.cc:1048] T 4279160d7f8446109052951d62dcde1d P 873f2b4fab6f42738b2d41b4608a592a [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:44.396260 3030 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d7c20d1745e54a9db1e0082a48ed06e4)
I20260429 08:00:44.396384 3030 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:44.396883 3030 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
W20260429 08:00:44.398084 2476 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
W20260429 08:00:44.398165 2479 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:00:44.398232 2479 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42; no voters: d7c20d1745e54a9db1e0082a48ed06e4, f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:44.398358 3030 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260429 08:00:45.174310 3045 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d7c20d1745e54a9db1e0082a48ed06e4)
I20260429 08:00:45.174423 3045 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:45.174839 3045 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
W20260429 08:00:45.175935 2479 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:45.176041 2476 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847): Network error: Client connection negotiation failed: client connection to 127.1.14.61:33847: connect: Connection refused (error 111)
I20260429 08:00:45.176119 2476 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42; no voters: d7c20d1745e54a9db1e0082a48ed06e4, f1e6af049ae04c6e98cb5e609f9be472
I20260429 08:00:45.176249 3045 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260429 08:00:45.838196 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.61:33847
--webserver_interface=127.1.14.61
--webserver_port=38285
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260429 08:00:45.936266 3055 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:45.936439 3055 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:45.936472 3055 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:45.939445 3055 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 08:00:45.939493 3055 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:45.939512 3055 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 08:00:45.939529 3055 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 08:00:45.942988 3055 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.61:33847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.14.61
--webserver_port=38285
--never_fsync=true
--heap_profile_path=/tmp/kudu.3055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:45.943892 3055 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:45.944913 3055 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:45.950127 3063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:45.950203 3055 server_base.cc:1061] running on GCE node
W20260429 08:00:45.950132 3061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:45.950127 3060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:45.950815 3055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:45.951495 3055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:45.952663 3055 hybrid_clock.cc:648] HybridClock initialized: now 1777449645952645 us; error 41 us; skew 500 ppm
I20260429 08:00:45.954360 3055 webserver.cc:492] Webserver started at http://127.1.14.61:38285/ using document root <none> and password file <none>
I20260429 08:00:45.954826 3055 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:45.954922 3055 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:45.957803 3055 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:45.959427 3069 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:45.960268 3055 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:45.960348 3055 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
uuid: "f1e6af049ae04c6e98cb5e609f9be472"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:45.960736 3055 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:45.989434 3055 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:45.989981 3055 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:45.990150 3055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:45.996416 3055 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.61:33847
I20260429 08:00:45.996421 3123 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.61:33847 every 8 connection(s)
I20260429 08:00:45.997299 3055 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
I20260429 08:00:46.000808 3124 sys_catalog.cc:263] Verifying existing consensus state
I20260429 08:00:46.002298 3124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Bootstrap starting.
I20260429 08:00:46.003404 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 3055
I20260429 08:00:46.011804 3124 log.cc:826] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:46.053014 3124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Bootstrap replayed 1/1 log segments. Stats: ops{read=88 overwritten=0 applied=87 ignored=0} inserts{seen=53 ignored=0} mutations{seen=73 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260429 08:00:46.053545 3124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Bootstrap complete.
I20260429 08:00:46.056250 3124 raft_consensus.cc:359] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 4 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:46.056973 3124 raft_consensus.cc:740] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1e6af049ae04c6e98cb5e609f9be472, State: Initialized, Role: FOLLOWER
I20260429 08:00:46.057438 3124 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 87, Last appended: 4.88, Last appended by leader: 88, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:46.057830 3130 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:46.058019 3130 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:46.058468 3124 sys_catalog.cc:565] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: configured and running, proceeding with master startup.
I20260429 08:00:46.060201 1917 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:46.062449 3088 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "353e59f343974ee68738535fb9029d30" instance_seqno: 1777449628847581) as {username='slave'} at 127.1.14.2:34565; Asking this server to re-register.
I20260429 08:00:46.063570 1917 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:46.064885 3144 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:46.064970 3144 catalog_manager.cc:1562] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: loading cluster ID for follower catalog manager: success
I20260429 08:00:46.064607 3055 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:00:46.066546 3055 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:46.067730 3144 catalog_manager.cc:1584] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: acquiring CA information for follower catalog manager: success
I20260429 08:00:46.068881 3088 ts_manager.cc:194] Registered new tserver with Master: 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:46.069052 3144 catalog_manager.cc:1612] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260429 08:00:46.096735 2053 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:46.098242 3088 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" instance_seqno: 1777449629023571) as {username='slave'} at 127.1.14.3:47499; Asking this server to re-register.
I20260429 08:00:46.098618 2053 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:46.099499 3088 ts_manager.cc:194] Registered new tserver with Master: 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:46.472072 1779 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:46.473449 3088 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6441a846e67a46159cef1413b6d06337" instance_seqno: 1777449628680786) as {username='slave'} at 127.1.14.1:47991; Asking this server to re-register.
I20260429 08:00:46.473886 1779 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:46.474742 3088 ts_manager.cc:194] Registered new tserver with Master: 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:46.530767 3130 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:46.531030 3130 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:46.532110 3130 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:46.532692 3073 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:46.533645 3073 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:00:46.535816 2501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1e6af049ae04c6e98cb5e609f9be472" candidate_term: 5 candidate_status { last_received { term: 4 index: 88 } } ignore_live_leader: false dest_uuid: "cd076a6196ef424a813003c9c5d53d42" is_pre_election: true
I20260429 08:00:46.535965 2501 raft_consensus.cc:2368] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1e6af049ae04c6e98cb5e609f9be472 for earlier term 5. Current term is 7.
I20260429 08:00:46.536419 3073 leader_election.cc:400] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 5 pre-election: Vote denied by peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1e6af049ae04c6e98cb5e609f9be472 for earlier term 5. Current term is 7.
I20260429 08:00:46.536478 3073 leader_election.cc:403] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260429 08:00:46.536713 3130 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 4 FOLLOWER]: Advancing to term 7
I20260429 08:00:46.538269 3130 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 7 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1e6af049ae04c6e98cb5e609f9be472 for earlier term 5. Current term is 7.
I20260429 08:00:46.680373 3155 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d7c20d1745e54a9db1e0082a48ed06e4)
I20260429 08:00:46.680497 3155 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:46.680883 3155 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
W20260429 08:00:46.682097 2479 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:00:46.684258 3098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd076a6196ef424a813003c9c5d53d42" candidate_term: 8 candidate_status { last_received { term: 7 index: 96 } } ignore_live_leader: false dest_uuid: "f1e6af049ae04c6e98cb5e609f9be472" is_pre_election: true
I20260429 08:00:46.684520 3098 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd076a6196ef424a813003c9c5d53d42 in term 7.
I20260429 08:00:46.684857 2476 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, f1e6af049ae04c6e98cb5e609f9be472; no voters: d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:46.685098 3155 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260429 08:00:46.685170 3155 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d7c20d1745e54a9db1e0082a48ed06e4)
I20260429 08:00:46.685237 3155 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 7 FOLLOWER]: Advancing to term 8
I20260429 08:00:46.686110 3155 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:46.686479 3155 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 election: Requested vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
I20260429 08:00:46.686851 3098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd076a6196ef424a813003c9c5d53d42" candidate_term: 8 candidate_status { last_received { term: 7 index: 96 } } ignore_live_leader: false dest_uuid: "f1e6af049ae04c6e98cb5e609f9be472"
I20260429 08:00:46.686956 3098 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 7 FOLLOWER]: Advancing to term 8
W20260429 08:00:46.687415 2479 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:00:46.687845 3098 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd076a6196ef424a813003c9c5d53d42 in term 8.
I20260429 08:00:46.688086 2476 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, f1e6af049ae04c6e98cb5e609f9be472; no voters: d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:46.688252 3155 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 8 FOLLOWER]: Leader election won for term 8
I20260429 08:00:46.688443 3155 raft_consensus.cc:697] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 8 LEADER]: Becoming Leader. State: Replica: cd076a6196ef424a813003c9c5d53d42, State: Running, Role: LEADER
I20260429 08:00:46.688745 3155 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 7.96, Last appended by leader: 96, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:46.689585 3159 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd076a6196ef424a813003c9c5d53d42. Latest consensus state: current_term: 8 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:46.689687 3159 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:46.689958 3161 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260429 08:00:46.691661 3161 catalog_manager.cc:679] Loaded metadata for table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]
I20260429 08:00:46.691942 3161 catalog_manager.cc:679] Loaded metadata for table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e]
I20260429 08:00:46.692143 3161 catalog_manager.cc:679] Loaded metadata for table default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8]
I20260429 08:00:46.692327 3161 catalog_manager.cc:679] Loaded metadata for table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]
I20260429 08:00:46.692504 3161 catalog_manager.cc:679] Loaded metadata for table default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156]
I20260429 08:00:46.692747 3161 catalog_manager.cc:679] Loaded metadata for table default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1]
I20260429 08:00:46.693001 3161 catalog_manager.cc:679] Loaded metadata for table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]
I20260429 08:00:46.693204 3161 catalog_manager.cc:679] Loaded metadata for table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]
I20260429 08:00:46.693413 3161 catalog_manager.cc:679] Loaded metadata for table default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3]
I20260429 08:00:46.693612 3161 catalog_manager.cc:679] Loaded metadata for table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]
I20260429 08:00:46.693804 3161 catalog_manager.cc:679] Loaded metadata for table default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b]
I20260429 08:00:46.694012 3161 catalog_manager.cc:679] Loaded metadata for table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]
I20260429 08:00:46.694197 3161 catalog_manager.cc:679] Loaded metadata for table default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b]
I20260429 08:00:46.694471 3161 catalog_manager.cc:679] Loaded metadata for table default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5]
I20260429 08:00:46.695775 3161 tablet_loader.cc:96] loaded metadata for tablet 0c763b359f5542888013123b2037b5d0 (table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47])
I20260429 08:00:46.696215 3161 tablet_loader.cc:96] loaded metadata for tablet 29d7fe3ebc3148a9be321460da8abdb5 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08])
I20260429 08:00:46.696574 3161 tablet_loader.cc:96] loaded metadata for tablet 3b29c11f78624a22922bae3070f194f3 (table default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1])
I20260429 08:00:46.696777 3161 tablet_loader.cc:96] loaded metadata for tablet 3d4069c79e8f4c36ba414169bd049b8f (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91])
I20260429 08:00:46.696933 3161 tablet_loader.cc:96] loaded metadata for tablet 4279160d7f8446109052951d62dcde1d (table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006])
I20260429 08:00:46.697110 3161 tablet_loader.cc:96] loaded metadata for tablet 43def4d831db44c09e060f4949e6f8ac (table default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b])
I20260429 08:00:46.697242 3161 tablet_loader.cc:96] loaded metadata for tablet 50ab0c1c41f54389a6fd480da7026f20 (table default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b])
I20260429 08:00:46.697431 3161 tablet_loader.cc:96] loaded metadata for tablet 5a2349526fb740f4b9c964cb9ecef4d6 (table default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5])
I20260429 08:00:46.697610 3161 tablet_loader.cc:96] loaded metadata for tablet 6fed5cc1d4c045408c1b3342e8baba02 (table default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8])
I20260429 08:00:46.697913 3161 tablet_loader.cc:96] loaded metadata for tablet 881e1249f58b4480ad5940e69ee49788 (table default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3])
I20260429 08:00:46.698206 3161 tablet_loader.cc:96] loaded metadata for tablet 93630bad9fdd46e9b982cd1b44665433 (table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e])
I20260429 08:00:46.698372 3161 tablet_loader.cc:96] loaded metadata for tablet 9622269e5988486a87b443646bf894cf (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07])
I20260429 08:00:46.698752 3161 tablet_loader.cc:96] loaded metadata for tablet aefbf6a8d8b14de6965475a82ba5c9c4 (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2])
I20260429 08:00:46.698930 3161 tablet_loader.cc:96] loaded metadata for tablet c1c2987616df4a438b5160e1fbc5387e (table default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156])
I20260429 08:00:46.699416 3161 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260429 08:00:46.699914 3161 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:46.699972 3161 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260429 08:00:46.700541 3161 catalog_manager.cc:1514] Loading token signing keys...
I20260429 08:00:46.701043 3161 catalog_manager.cc:6055] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Loaded TSK: 0
I20260429 08:00:46.701547 3161 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260429 08:00:46.701999 3161 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260429 08:00:46.702447 3161 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 20
I20260429 08:00:46.759183 2491 master_service.cc:954] ReplaceTablet: received request to replace tablet 29d7fe3ebc3148a9be321460da8abdb5 from {username='slave'} at 127.0.0.1:59430
I20260429 08:00:46.759368 2489 master_service.cc:954] ReplaceTablet: received request to replace tablet 3b29c11f78624a22922bae3070f194f3 from {username='slave'} at 127.0.0.1:59430
I20260429 08:00:46.759493 2490 master_service.cc:954] ReplaceTablet: received request to replace tablet c1c2987616df4a438b5160e1fbc5387e from {username='slave'} at 127.0.0.1:59430
I20260429 08:00:46.759176 2492 master_service.cc:954] ReplaceTablet: received request to replace tablet 3d4069c79e8f4c36ba414169bd049b8f from {username='slave'} at 127.0.0.1:59430
I20260429 08:00:46.760068 2488 master_service.cc:954] ReplaceTablet: received request to replace tablet 3b29c11f78624a22922bae3070f194f3 from {username='slave'} at 127.0.0.1:59430
I20260429 08:00:46.760025 2483 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59430:
name: "default.Table_b1938a0ba6d9429ba63271d6f958a060"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:46.760326 2487 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59430:
table { table_name: "default.Table_6795420cac01458198a3bf0876fd6092" } new_table_name: "default.Table_7d633f7b157e487daf0b0a993a8a71bc" modify_external_catalogs: true
I20260429 08:00:46.760661 2486 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59430:
table { table_name: "default.Table_a3cf45aaf37c4ddf9ed00173d7c72a4c" } modify_external_catalogs: true
I20260429 08:00:46.760787 2486 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59430:
table { table_name: "default.Table_a3cf45aaf37c4ddf9ed00173d7c72a4c" } modify_external_catalogs: true
I20260429 08:00:46.760962 2485 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59430:
table { table_name: "default.Table_00c8e8b0543b48458c08b780734269c6" } new_table_name: "default.Table_1bb6d84b6ef5474eb7270ecbd2c1af77" modify_external_catalogs: true
I20260429 08:00:46.761164 2484 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59430:
table { table_name: "default.Table_ec6b6e2df1d545c78484235081b96327" } modify_external_catalogs: true
I20260429 08:00:46.761243 2484 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59430:
table { table_name: "default.Table_ec6b6e2df1d545c78484235081b96327" } modify_external_catalogs: true
I20260429 08:00:46.763252 3098 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Refusing update from remote peer cd076a6196ef424a813003c9c5d53d42: Log matching property violated. Preceding OpId in replica: term: 4 index: 88. Preceding OpId from leader: term: 8 index: 98. (index mismatch)
I20260429 08:00:46.763886 3159 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 87, Time since last communication: 0.000s
I20260429 08:00:46.764151 3159 consensus_queue.cc:1243] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [LEADER]: Peer f1e6af049ae04c6e98cb5e609f9be472 log is divergent from this leader: its last log entry 4.88 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 87
W20260429 08:00:46.764333 2479 consensus_peers.cc:597] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 -> Peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Couldn't send request to peer d7c20d1745e54a9db1e0082a48ed06e4. Status: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260429 08:00:46.765286 3098 pending_rounds.cc:85] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Aborting all ops after (but not including) 87
I20260429 08:00:46.765357 3098 pending_rounds.cc:107] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Aborting uncommitted NO_OP operation due to leader change: 4.88
I20260429 08:00:46.765414 3098 raft_consensus.cc:2889] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
F20260429 08:00:46.766680 2546 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 23, previous 23; dumping first 4 out of 13 received events: NotificationEvent(eventId=21, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_207de250815e4c1793355de8d028abec, message={"server":"","servicePrincipal":"","db":"default","table":"table_207de250815e4c1793355de8d028abec","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_207de250815e4c1793355de8d028abec\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_207de250815e4c1793355de8d028abec\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_207de250815e4c1793355de8d028abec\",\"kudu.table_id\":\"76db81fc69b8490d98c0496a830d00c2\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1777449632, eventType=CREATE_TABLE, dbName=default, tableName=table_91fe24cd92b444e1bd97440b6e584816, message={"server":"","servicePrincipal":"","db":"default","table":"table_91fe24cd92b444e1bd97440b6e584816","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_91fe24cd92b444e1bd97440b6e584816\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449632},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_91fe24cd92b444e1bd97440b6e584816\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_91fe24cd92b444e1bd97440b6e584816\",\"kudu.table_id\":\"85f2230320084f08a7b147f7efd77ed1\",\"transient_lastDdlTime\":\"1777449632\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_34261e3d16e14d888f3f3fd3c436b4ad, message={"server":"","servicePrincipal":"","db":"default","table":"table_34261e3d16e14d888f3f3fd3c436b4ad","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449630},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_34261e3d16e14d888f3f3fd3c436b4ad\",\"kudu.table_id\":\"ba5133c5668141589469ba6e26f75c47\",\"transient_lastDdlTime\":\"1777449630\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_012320bc4c054b62be2e415bca912daf, message={"server":"","servicePrincipal":"","db":"default","table":"table_012320bc4c054b62be2e415bca912daf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_012320bc4c054b62be2e415bca912daf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_012320bc4c054b62be2e415bca912daf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_012320bc4c054b62be2e415bca912daf\",\"kudu.table_id\":\"038ee5f1404b4d3ca452c21bfa0253e6\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f1c54c99dcd google::LogMessage::Fail() at ??:0
I20260429 08:00:46.770602 3130 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd076a6196ef424a813003c9c5d53d42. Latest consensus state: current_term: 8 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:46.770740 3130 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:46.770967 3166 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:46.771054 3166 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:46.771237 3165 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:46.771318 3165 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:46.771510 3167 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:46.771617 3167 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f1c54c9db93 google::LogMessage::SendToLog() at ??:0
I20260429 08:00:46.772521 3163 mvcc.cc:204] Tried to move back new op lower bound from 7280433738945724416 to 7280433715749208064. Current Snapshot: MvccSnapshot[applied={T|T < 7280433738945724416}]
I20260429 08:00:46.773084 3167 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:46.773175 3167 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f1c54c997cc google::LogMessage::Flush() at ??:0
I20260429 08:00:46.775032 3173 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:46.775141 3173 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: LEADER
@ 0x7f1c54c99a11 google::LogMessage::~LogMessage() at ??:0
I20260429 08:00:46.777266 2489 catalog_manager.cc:5958] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Sending DeleteTablet for 3 replicas of tablet 3b29c11f78624a22922bae3070f194f3
I20260429 08:00:46.777668 2488 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59430:
table { table_name: "default.Table_03bb29fc9f854e85b7fc52f6523c6db0" } modify_external_catalogs: true
I20260429 08:00:46.777719 2491 catalog_manager.cc:5958] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Sending DeleteTablet for 3 replicas of tablet 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:00:46.777770 2488 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59430:
table { table_name: "default.Table_03bb29fc9f854e85b7fc52f6523c6db0" } modify_external_catalogs: true
I20260429 08:00:46.777958 2490 catalog_manager.cc:5958] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Sending DeleteTablet for 3 replicas of tablet c1c2987616df4a438b5160e1fbc5387e
I20260429 08:00:46.778100 2492 catalog_manager.cc:5958] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Sending DeleteTablet for 3 replicas of tablet 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:00:46.778244 2489 catalog_manager.cc:6741] ReplaceTablet: tablet 3b29c11f78624a22922bae3070f194f3 deleted and replaced by tablet aecf5920885d49e0b8388a79eefb6108
I20260429 08:00:46.778316 2492 catalog_manager.cc:6741] ReplaceTablet: tablet 3d4069c79e8f4c36ba414169bd049b8f deleted and replaced by tablet d89c55601ea74fc3939db290586ce05a
I20260429 08:00:46.778393 2489 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59430:
table { table_name: "default.Table_34261e3d16e14d888f3f3fd3c436b4ad" } modify_external_catalogs: true
I20260429 08:00:46.778450 2492 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59430:
name: "default.Table_012320bc4c054b62be2e415bca912daf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:46.778484 2489 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59430:
table { table_name: "default.Table_34261e3d16e14d888f3f3fd3c436b4ad" } modify_external_catalogs: true
I20260429 08:00:46.779496 2491 catalog_manager.cc:6741] ReplaceTablet: tablet 29d7fe3ebc3148a9be321460da8abdb5 deleted and replaced by tablet 664e479f600745dc99596f4bc469dcaa
I20260429 08:00:46.779665 2491 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59430:
table { table_name: "default.Table_3b6223798dcd434c989986f1d5727b55" } new_table_name: "default.Table_2cdd9567b5794d2f89bd56027f9fe823" modify_external_catalogs: true
I20260429 08:00:46.780063 2490 catalog_manager.cc:6741] ReplaceTablet: tablet c1c2987616df4a438b5160e1fbc5387e deleted and replaced by tablet 5e64aac0f06e454898f6622c9486ccec
I20260429 08:00:46.780287 2490 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59430:
name: "default.Table_207de250815e4c1793355de8d028abec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:46.784982 1846 tablet_service.cc:1558] Processing DeleteTablet for tablet 29d7fe3ebc3148a9be321460da8abdb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 664e479f600745dc99596f4bc469dcaa) from {username='slave'} at 127.0.0.1:36496
I20260429 08:00:46.785146 1847 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b29c11f78624a22922bae3070f194f3 with delete_type TABLET_DATA_DELETED (replaced by tablet aecf5920885d49e0b8388a79eefb6108) from {username='slave'} at 127.0.0.1:36496
I20260429 08:00:46.785192 1844 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d4069c79e8f4c36ba414169bd049b8f with delete_type TABLET_DATA_DELETED (replaced by tablet d89c55601ea74fc3939db290586ce05a) from {username='slave'} at 127.0.0.1:36496
I20260429 08:00:46.785290 1845 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c2987616df4a438b5160e1fbc5387e with delete_type TABLET_DATA_DELETED (replaced by tablet 5e64aac0f06e454898f6622c9486ccec) from {username='slave'} at 127.0.0.1:36496
I20260429 08:00:46.785784 1845 tablet_service.cc:1511] Processing CreateTablet for tablet 664e479f600745dc99596f4bc469dcaa (DEFAULT_TABLE table=default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:46.786093 1845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 664e479f600745dc99596f4bc469dcaa. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f1c5a20d433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260429 08:00:46.787156 3184 tablet_replica.cc:333] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:46.787395 3184 raft_consensus.cc:2243] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:46.787604 3184 raft_consensus.cc:2272] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:46.788055 3184 ts_tablet_manager.cc:1916] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:46.788793 3186 tablet_bootstrap.cc:492] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:46.789198 1844 tablet_service.cc:1511] Processing CreateTablet for tablet 5e64aac0f06e454898f6622c9486ccec (DEFAULT_TABLE table=default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:46.789276 1847 tablet_service.cc:1511] Processing CreateTablet for tablet aecf5920885d49e0b8388a79eefb6108 (DEFAULT_TABLE table=default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:46.789419 1844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e64aac0f06e454898f6622c9486ccec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:46.789659 1845 tablet_service.cc:1511] Processing CreateTablet for tablet d89c55601ea74fc3939db290586ce05a (DEFAULT_TABLE table=default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:46.789882 1845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89c55601ea74fc3939db290586ce05a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:46.790050 3186 tablet_bootstrap.cc:654] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
@ 0x7f1c5a20c34a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260429 08:00:46.791309 1847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecf5920885d49e0b8388a79eefb6108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:46.792270 3184 ts_tablet_manager.cc:1929] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:46.792332 3184 log.cc:1199] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:00:46.792678 3184 ts_tablet_manager.cc:1950] T 29d7fe3ebc3148a9be321460da8abdb5 P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:46.793324 3184 tablet_replica.cc:333] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:46.793428 3184 raft_consensus.cc:2243] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:46.793586 3184 raft_consensus.cc:2272] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:46.793748 2478 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet 29d7fe3ebc3148a9be321460da8abdb5 (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]) successfully deleted
I20260429 08:00:46.794304 3184 ts_tablet_manager.cc:1916] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f1c5a20baad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260429 08:00:46.796730 3184 ts_tablet_manager.cc:1929] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:46.796795 3184 log.cc:1199] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/3b29c11f78624a22922bae3070f194f3
I20260429 08:00:46.797037 3184 ts_tablet_manager.cc:1950] T 3b29c11f78624a22922bae3070f194f3 P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:46.797473 3186 tablet_bootstrap.cc:492] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:46.797541 3186 ts_tablet_manager.cc:1403] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260429 08:00:46.797556 3184 tablet_replica.cc:333] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:46.797640 3184 raft_consensus.cc:2243] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:46.797782 3184 raft_consensus.cc:2272] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:46.797950 3186 raft_consensus.cc:359] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.798032 3186 raft_consensus.cc:385] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:46.798058 3184 ts_tablet_manager.cc:1916] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:46.798059 3186 raft_consensus.cc:740] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
@ 0x7f1c5a2111b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260429 08:00:46.798202 3186 consensus_queue.cc:260] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.798338 2478 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet 3b29c11f78624a22922bae3070f194f3 (table default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1]) successfully deleted
I20260429 08:00:46.799796 3184 ts_tablet_manager.cc:1929] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:46.799857 3184 log.cc:1199] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/3d4069c79e8f4c36ba414169bd049b8f
@ 0x55ca57632244 std::function<>::operator()() at ??:0
I20260429 08:00:46.800004 3186 ts_tablet_manager.cc:1434] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:46.800102 1705 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c2987616df4a438b5160e1fbc5387e with delete_type TABLET_DATA_DELETED (replaced by tablet 5e64aac0f06e454898f6622c9486ccec) from {username='slave'} at 127.0.0.1:34098
I20260429 08:00:46.800352 1707 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d4069c79e8f4c36ba414169bd049b8f with delete_type TABLET_DATA_DELETED (replaced by tablet d89c55601ea74fc3939db290586ce05a) from {username='slave'} at 127.0.0.1:34098
I20260429 08:00:46.800559 1710 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b29c11f78624a22922bae3070f194f3 with delete_type TABLET_DATA_DELETED (replaced by tablet aecf5920885d49e0b8388a79eefb6108) from {username='slave'} at 127.0.0.1:34098
I20260429 08:00:46.800650 1705 tablet_service.cc:1511] Processing CreateTablet for tablet 5e64aac0f06e454898f6622c9486ccec (DEFAULT_TABLE table=default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:46.800747 1706 tablet_service.cc:1558] Processing DeleteTablet for tablet 29d7fe3ebc3148a9be321460da8abdb5 with delete_type TABLET_DATA_DELETED (replaced by tablet 664e479f600745dc99596f4bc469dcaa) from {username='slave'} at 127.0.0.1:34098
I20260429 08:00:46.800782 3186 tablet_bootstrap.cc:492] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:46.800915 1705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e64aac0f06e454898f6622c9486ccec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:46.801010 1708 tablet_service.cc:1511] Processing CreateTablet for tablet 664e479f600745dc99596f4bc469dcaa (DEFAULT_TABLE table=default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:46.801312 1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 664e479f600745dc99596f4bc469dcaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:46.801653 3186 tablet_bootstrap.cc:654] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
@ 0x7f1c5619e7ea kudu::Thread::SuperviseThread() at ??:0
I20260429 08:00:46.803457 3184 ts_tablet_manager.cc:1950] T 3d4069c79e8f4c36ba414169bd049b8f P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:46.803853 1709 tablet_service.cc:1511] Processing CreateTablet for tablet d89c55601ea74fc3939db290586ce05a (DEFAULT_TABLE table=default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:46.804108 1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89c55601ea74fc3939db290586ce05a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:46.804088 2478 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet 3d4069c79e8f4c36ba414169bd049b8f (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]) successfully deleted
I20260429 08:00:46.804241 3184 tablet_replica.cc:333] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30: stopping tablet replica
I20260429 08:00:46.804353 3184 raft_consensus.cc:2243] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:46.804451 3184 raft_consensus.cc:2272] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:46.804832 3184 ts_tablet_manager.cc:1916] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:46.805847 3189 tablet_replica.cc:333] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
@ 0x7f1c56ae36db start_thread at ??:0
I20260429 08:00:46.805962 3189 raft_consensus.cc:2243] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Raft consensus shutting down.
I20260429 08:00:46.806138 3189 raft_consensus.cc:2272] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:46.806480 3189 ts_tablet_manager.cc:1916] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:46.806612 1711 tablet_service.cc:1511] Processing CreateTablet for tablet aecf5920885d49e0b8388a79eefb6108 (DEFAULT_TABLE table=default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260429 08:00:46.806741 3184 ts_tablet_manager.cc:1929] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:46.806808 3184 log.cc:1199] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-1/wal/wals/c1c2987616df4a438b5160e1fbc5387e
I20260429 08:00:46.806871 1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecf5920885d49e0b8388a79eefb6108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:46.807039 3184 ts_tablet_manager.cc:1950] T c1c2987616df4a438b5160e1fbc5387e P 353e59f343974ee68738535fb9029d30: Deleting consensus metadata
I20260429 08:00:46.807703 2478 catalog_manager.cc:5002] TS 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): tablet c1c2987616df4a438b5160e1fbc5387e (table default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156]) successfully deleted
@ 0x7f1c53e5061f clone at ??:0
I20260429 08:00:46.808177 3186 tablet_bootstrap.cc:492] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:46.808238 3186 ts_tablet_manager.cc:1403] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260429 08:00:46.808475 3191 tablet_bootstrap.cc:492] T 5e64aac0f06e454898f6622c9486ccec P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:46.808660 3186 raft_consensus.cc:359] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.808748 3186 raft_consensus.cc:385] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:46.808779 3186 raft_consensus.cc:740] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:46.808913 3186 consensus_queue.cc:260] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.809154 3186 ts_tablet_manager.cc:1434] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:46.809306 3186 tablet_bootstrap.cc:492] T aecf5920885d49e0b8388a79eefb6108 P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:46.810163 3186 tablet_bootstrap.cc:654] T aecf5920885d49e0b8388a79eefb6108 P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:46.810261 3191 tablet_bootstrap.cc:654] T 5e64aac0f06e454898f6622c9486ccec P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:46.811167 3186 tablet_bootstrap.cc:492] T aecf5920885d49e0b8388a79eefb6108 P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:46.811239 3186 ts_tablet_manager.cc:1403] T aecf5920885d49e0b8388a79eefb6108 P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:46.811677 3186 raft_consensus.cc:359] T aecf5920885d49e0b8388a79eefb6108 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.811770 3186 raft_consensus.cc:385] T aecf5920885d49e0b8388a79eefb6108 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:46.811800 3186 raft_consensus.cc:740] T aecf5920885d49e0b8388a79eefb6108 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:46.811915 3186 consensus_queue.cc:260] T aecf5920885d49e0b8388a79eefb6108 P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.812150 3189 ts_tablet_manager.cc:1929] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:46.812157 3186 ts_tablet_manager.cc:1434] T aecf5920885d49e0b8388a79eefb6108 P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:46.812196 3189 log.cc:1199] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/c1c2987616df4a438b5160e1fbc5387e
I20260429 08:00:46.812335 3186 tablet_bootstrap.cc:492] T d89c55601ea74fc3939db290586ce05a P 353e59f343974ee68738535fb9029d30: Bootstrap starting.
I20260429 08:00:46.812493 3189 ts_tablet_manager.cc:1950] T c1c2987616df4a438b5160e1fbc5387e P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:46.813390 3189 tablet_replica.cc:333] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:46.813500 3189 raft_consensus.cc:2243] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:46.813612 3189 raft_consensus.cc:2272] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:46.813946 3189 ts_tablet_manager.cc:1916] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:46.814386 3186 tablet_bootstrap.cc:654] T d89c55601ea74fc3939db290586ce05a P 353e59f343974ee68738535fb9029d30: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:46.815467 3191 tablet_bootstrap.cc:492] T 5e64aac0f06e454898f6622c9486ccec P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:46.815534 3191 ts_tablet_manager.cc:1403] T 5e64aac0f06e454898f6622c9486ccec P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260429 08:00:46.815589 3189 ts_tablet_manager.cc:1929] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260429 08:00:46.815656 3189 log.cc:1199] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:00:46.815862 3189 ts_tablet_manager.cc:1950] T 3d4069c79e8f4c36ba414169bd049b8f P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:46.816035 3191 raft_consensus.cc:359] T 5e64aac0f06e454898f6622c9486ccec P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.816134 3191 raft_consensus.cc:385] T 5e64aac0f06e454898f6622c9486ccec P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:46.816169 3191 raft_consensus.cc:740] T 5e64aac0f06e454898f6622c9486ccec P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:46.816377 3191 consensus_queue.cc:260] T 5e64aac0f06e454898f6622c9486ccec P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.816450 3189 tablet_replica.cc:333] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:46.816672 3191 ts_tablet_manager.cc:1434] T 5e64aac0f06e454898f6622c9486ccec P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:46.817070 3186 tablet_bootstrap.cc:492] T d89c55601ea74fc3939db290586ce05a P 353e59f343974ee68738535fb9029d30: No bootstrap required, opened a new log
I20260429 08:00:46.817083 3191 tablet_bootstrap.cc:492] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:46.817134 3186 ts_tablet_manager.cc:1403] T d89c55601ea74fc3939db290586ce05a P 353e59f343974ee68738535fb9029d30: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260429 08:00:46.817654 3186 raft_consensus.cc:359] T d89c55601ea74fc3939db290586ce05a P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.817759 3186 raft_consensus.cc:385] T d89c55601ea74fc3939db290586ce05a P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:46.817809 3186 raft_consensus.cc:740] T d89c55601ea74fc3939db290586ce05a P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 353e59f343974ee68738535fb9029d30, State: Initialized, Role: FOLLOWER
I20260429 08:00:46.817996 3191 tablet_bootstrap.cc:654] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:46.817946 3186 consensus_queue.cc:260] T d89c55601ea74fc3939db290586ce05a P 353e59f343974ee68738535fb9029d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.818277 3186 ts_tablet_manager.cc:1434] T d89c55601ea74fc3939db290586ce05a P 353e59f343974ee68738535fb9029d30: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:46.820322 3189 raft_consensus.cc:2243] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:46.820421 3189 raft_consensus.cc:2272] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:46.820721 3189 ts_tablet_manager.cc:1916] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:46.822788 3189 ts_tablet_manager.cc:1929] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:46.822883 3189 log.cc:1199] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/3b29c11f78624a22922bae3070f194f3
I20260429 08:00:46.823134 3189 ts_tablet_manager.cc:1950] T 3b29c11f78624a22922bae3070f194f3 P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:46.823740 3189 tablet_replica.cc:333] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337: stopping tablet replica
I20260429 08:00:46.823793 3191 tablet_bootstrap.cc:492] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:46.823839 3189 raft_consensus.cc:2243] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260429 08:00:46.823881 3191 ts_tablet_manager.cc:1403] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260429 08:00:46.823944 3189 raft_consensus.cc:2272] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260429 08:00:46.824433 3191 raft_consensus.cc:359] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.824517 3191 raft_consensus.cc:385] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:46.824540 3191 raft_consensus.cc:740] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:46.824735 3191 consensus_queue.cc:260] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.825137 3189 ts_tablet_manager.cc:1916] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260429 08:00:46.825697 3191 ts_tablet_manager.cc:1434] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260429 08:00:46.826455 3191 tablet_bootstrap.cc:492] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:46.826941 3189 ts_tablet_manager.cc:1929] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260429 08:00:46.826993 3189 log.cc:1199] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337: Deleting WAL directory at /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/ts-0/wal/wals/29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:00:46.827279 3189 ts_tablet_manager.cc:1950] T 29d7fe3ebc3148a9be321460da8abdb5 P 6441a846e67a46159cef1413b6d06337: Deleting consensus metadata
I20260429 08:00:46.827596 3191 tablet_bootstrap.cc:654] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:46.828768 3191 tablet_bootstrap.cc:492] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:46.828840 3191 ts_tablet_manager.cc:1403] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260429 08:00:46.829339 3191 raft_consensus.cc:359] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.829447 3191 raft_consensus.cc:385] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:46.829483 3191 raft_consensus.cc:740] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:46.829627 3191 consensus_queue.cc:260] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.830591 3191 ts_tablet_manager.cc:1434] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:46.831385 3191 tablet_bootstrap.cc:492] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337: Bootstrap starting.
I20260429 08:00:46.832408 3191 tablet_bootstrap.cc:654] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337: Neither blocks nor log segments found. Creating new log.
I20260429 08:00:46.833551 3191 tablet_bootstrap.cc:492] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337: No bootstrap required, opened a new log
I20260429 08:00:46.833626 3191 ts_tablet_manager.cc:1403] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:46.834101 3191 raft_consensus.cc:359] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.834198 3191 raft_consensus.cc:385] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260429 08:00:46.834233 3191 raft_consensus.cc:740] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Initialized, Role: FOLLOWER
I20260429 08:00:46.834378 3191 consensus_queue.cc:260] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.835386 3191 ts_tablet_manager.cc:1434] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:46.851873 3036 raft_consensus.cc:493] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:46.851986 3036 raft_consensus.cc:515] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.852445 3036 leader_election.cc:290] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:46.852922 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89c55601ea74fc3939db290586ce05a" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:46.853057 1867 raft_consensus.cc:2468] T d89c55601ea74fc3939db290586ce05a P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
W20260429 08:00:46.853212 1667 leader_election.cc:343] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Not found: Tablet not found: d89c55601ea74fc3939db290586ce05a
I20260429 08:00:46.853444 1666 leader_election.cc:304] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters: 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:46.853626 3036 raft_consensus.cc:2804] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:46.853693 3036 raft_consensus.cc:493] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:46.853737 3036 raft_consensus.cc:3060] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:46.854679 3036 raft_consensus.cc:515] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.854975 3036 leader_election.cc:290] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Requested vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:46.855281 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89c55601ea74fc3939db290586ce05a" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:46.855374 1867 raft_consensus.cc:3060] T d89c55601ea74fc3939db290586ce05a P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
W20260429 08:00:46.855460 1667 leader_election.cc:343] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Not found: Tablet not found: d89c55601ea74fc3939db290586ce05a
I20260429 08:00:46.856313 1867 raft_consensus.cc:2468] T d89c55601ea74fc3939db290586ce05a P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:46.856559 1666 leader_election.cc:304] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters: 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:46.856758 3036 raft_consensus.cc:2804] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:46.856947 3036 raft_consensus.cc:697] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Becoming Leader. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Running, Role: LEADER
I20260429 08:00:46.857069 3036 consensus_queue.cc:237] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.937613 3205 raft_consensus.cc:493] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:46.937779 3205 raft_consensus.cc:515] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.938330 3205 leader_election.cc:290] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:46.938827 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecf5920885d49e0b8388a79eefb6108" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:46.938992 1867 raft_consensus.cc:2468] T aecf5920885d49e0b8388a79eefb6108 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
W20260429 08:00:46.939211 1667 leader_election.cc:343] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Not found: Tablet not found: aecf5920885d49e0b8388a79eefb6108
I20260429 08:00:46.939457 1666 leader_election.cc:304] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters: 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:46.939626 3205 raft_consensus.cc:2804] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:46.939688 3205 raft_consensus.cc:493] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:46.939744 3205 raft_consensus.cc:3060] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:46.940948 3205 raft_consensus.cc:515] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.941322 3205 leader_election.cc:290] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Requested vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:46.941581 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aecf5920885d49e0b8388a79eefb6108" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:46.941737 1867 raft_consensus.cc:3060] T aecf5920885d49e0b8388a79eefb6108 P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
W20260429 08:00:46.941905 1667 leader_election.cc:343] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Not found: Tablet not found: aecf5920885d49e0b8388a79eefb6108
I20260429 08:00:46.942502 1867 raft_consensus.cc:2468] T aecf5920885d49e0b8388a79eefb6108 P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 1.
I20260429 08:00:46.942790 1666 leader_election.cc:304] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters: 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:46.942991 3205 raft_consensus.cc:2804] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:46.943104 3205 raft_consensus.cc:697] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [term 1 LEADER]: Becoming Leader. State: Replica: 6441a846e67a46159cef1413b6d06337, State: Running, Role: LEADER
I20260429 08:00:46.943241 3205 consensus_queue.cc:237] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
W20260429 08:00:46.962442 1665 connection.cc:570] server connection from 127.0.0.1:34098 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:46.962693 1667 connection.cc:570] client connection to 127.1.14.60:41737 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260429 08:00:46.962765 3179 negotiation.cc:336] Failed RPC negotiation. Trace:
0429 08:00:46.778765 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:47304 (local address 127.1.14.3:33279)
0429 08:00:46.809321 (+ 30556us) server_negotiation.cc:207] Beginning negotiation
0429 08:00:46.809325 (+ 4us) server_negotiation.cc:400] Waiting for connection header
0429 08:00:46.809338 (+ 13us) server_negotiation.cc:408] Connection header received
0429 08:00:46.809382 (+ 44us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0429 08:00:46.809385 (+ 3us) server_negotiation.cc:462] Received NEGOTIATE request from client
0429 08:00:46.809435 (+ 50us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0429 08:00:46.809503 (+ 68us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0429 08:00:46.962586 (+153083us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47304: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":30469,"thread_start_us":64,"threads_started":1}
W20260429 08:00:46.963359 2061 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.14.60:41737)
I20260429 08:00:46.963413 3027 raft_consensus.cc:493] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:46.963526 3027 raft_consensus.cc:515] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
W20260429 08:00:46.963789 2061 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.1.14.60:41737)
W20260429 08:00:46.963905 2061 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.1.14.60:41737)
I20260429 08:00:46.964089 3027 leader_election.cc:290] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:46.964991 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e64aac0f06e454898f6622c9486ccec" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:46.965131 1729 raft_consensus.cc:2468] T 5e64aac0f06e454898f6622c9486ccec P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
W20260429 08:00:46.965364 3129 negotiation.cc:336] Failed RPC negotiation. Trace:
0429 08:00:46.963592 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.1.14.60:41737 (local address 127.1.14.2:38889)
0429 08:00:46.963794 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0429 08:00:46.963810 (+ 16us) client_negotiation.cc:175] Beginning negotiation
0429 08:00:46.963900 (+ 90us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0429 08:00:46.965242 (+ 1342us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":118}
I20260429 08:00:46.965445 1803 leader_election.cc:304] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
W20260429 08:00:46.965658 3151 negotiation.cc:336] Failed RPC negotiation. Trace:
0429 08:00:46.964159 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.1.14.60:41737 (local address 127.1.14.1:33011)
0429 08:00:46.964755 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0429 08:00:46.964769 (+ 14us) client_negotiation.cc:175] Beginning negotiation
0429 08:00:46.964848 (+ 79us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0429 08:00:46.965056 (+ 208us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":513}
W20260429 08:00:46.965737 1805 leader_election.cc:343] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Not found: Tablet not found: 5e64aac0f06e454898f6622c9486ccec
I20260429 08:00:46.965939 3027 raft_consensus.cc:2804] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:46.965996 3027 raft_consensus.cc:493] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:46.966040 3027 raft_consensus.cc:3060] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
W20260429 08:00:46.966635 2847 negotiation.cc:336] Failed RPC negotiation. Trace:
0429 08:00:46.964937 (+ 0us) reactor.cc:678] Submitting negotiation task for client connection to 127.1.14.60:41737 (local address 127.0.0.1:49082)
0429 08:00:46.965261 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0429 08:00:46.965272 (+ 11us) client_negotiation.cc:175] Beginning negotiation
0429 08:00:46.965363 (+ 91us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0429 08:00:46.966029 (+ 666us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":84,"threads_started":1}
I20260429 08:00:46.966960 3027 raft_consensus.cc:515] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:46.967325 3027 leader_election.cc:290] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:46.967615 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e64aac0f06e454898f6622c9486ccec" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:46.967720 1729 raft_consensus.cc:3060] T 5e64aac0f06e454898f6622c9486ccec P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
W20260429 08:00:46.967849 1805 leader_election.cc:343] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Not found: Tablet not found: 5e64aac0f06e454898f6622c9486ccec
I20260429 08:00:46.968410 1729 raft_consensus.cc:2468] T 5e64aac0f06e454898f6622c9486ccec P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
I20260429 08:00:46.968729 1803 leader_election.cc:304] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters: 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:46.968910 3027 raft_consensus.cc:2804] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260429 08:00:46.969120 3027 raft_consensus.cc:697] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [term 1 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:46.969262 3027 consensus_queue.cc:237] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
W20260429 08:00:46.981580 2061 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.1.14.60:41737)
I20260429 08:00:47.234669 3205 consensus_queue.cc:1048] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260429 08:00:47.238297 1667 consensus_peers.cc:597] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337 -> Peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Couldn't send request to peer 873f2b4fab6f42738b2d41b4608a592a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d89c55601ea74fc3939db290586ce05a. This is attempt 1: this message will repeat every 5th retry.
I20260429 08:00:47.258843 3027 raft_consensus.cc:493] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:47.258970 3027 raft_consensus.cc:515] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:47.259442 3027 leader_election.cc:290] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:47.259651 3215 raft_consensus.cc:493] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:47.259755 3215 raft_consensus.cc:515] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:47.259863 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664e479f600745dc99596f4bc469dcaa" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:47.259970 1729 raft_consensus.cc:2468] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 0.
I20260429 08:00:47.260162 3215 leader_election.cc:290] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
W20260429 08:00:47.260201 1805 leader_election.cc:343] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Not found: Tablet not found: 664e479f600745dc99596f4bc469dcaa
I20260429 08:00:47.260326 1805 leader_election.cc:304] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters: 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:47.260448 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664e479f600745dc99596f4bc469dcaa" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30" is_pre_election: true
I20260429 08:00:47.260527 3027 raft_consensus.cc:2804] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:47.260612 1867 raft_consensus.cc:2468] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6441a846e67a46159cef1413b6d06337 in term 0.
I20260429 08:00:47.260653 3027 raft_consensus.cc:493] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:47.260692 3027 raft_consensus.cc:3060] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:47.260983 1666 leader_election.cc:304] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters:
W20260429 08:00:47.261089 1667 leader_election.cc:343] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Not found: Tablet not found: 664e479f600745dc99596f4bc469dcaa
I20260429 08:00:47.261188 3215 raft_consensus.cc:2804] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260429 08:00:47.261247 3215 raft_consensus.cc:493] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:47.261299 3215 raft_consensus.cc:3060] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 0 FOLLOWER]: Advancing to term 1
I20260429 08:00:47.261727 3027 raft_consensus.cc:515] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:47.262074 3027 leader_election.cc:290] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Requested vote from peers 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:47.262171 3215 raft_consensus.cc:515] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:47.262348 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664e479f600745dc99596f4bc469dcaa" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:47.262490 1729 raft_consensus.cc:2393] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 353e59f343974ee68738535fb9029d30 in current term 1: Already voted for candidate 6441a846e67a46159cef1413b6d06337 in this term.
W20260429 08:00:47.262555 1805 leader_election.cc:343] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Not found: Tablet not found: 664e479f600745dc99596f4bc469dcaa
I20260429 08:00:47.262603 3215 leader_election.cc:290] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Requested vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:47.262796 1803 leader_election.cc:304] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 353e59f343974ee68738535fb9029d30; no voters: 6441a846e67a46159cef1413b6d06337, 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:47.262892 1867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664e479f600745dc99596f4bc469dcaa" candidate_uuid: "6441a846e67a46159cef1413b6d06337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "353e59f343974ee68738535fb9029d30"
I20260429 08:00:47.262993 3027 raft_consensus.cc:2749] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260429 08:00:47.263118 1867 raft_consensus.cc:2393] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6441a846e67a46159cef1413b6d06337 in current term 1: Already voted for candidate 353e59f343974ee68738535fb9029d30 in this term.
W20260429 08:00:47.263394 1667 leader_election.cc:343] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Not found: Tablet not found: 664e479f600745dc99596f4bc469dcaa
I20260429 08:00:47.263449 1667 leader_election.cc:304] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6441a846e67a46159cef1413b6d06337; no voters: 353e59f343974ee68738535fb9029d30, 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:47.263571 3215 raft_consensus.cc:2749] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260429 08:00:47.285313 3218 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd076a6196ef424a813003c9c5d53d42)
I20260429 08:00:47.285411 3218 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:47.285856 3218 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:47.287225 3073 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:47.287350 3073 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:47.287407 3073 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:47.287612 3218 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260429 08:00:47.348995 1667 consensus_peers.cc:597] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 -> Peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Couldn't send request to peer 873f2b4fab6f42738b2d41b4608a592a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aecf5920885d49e0b8388a79eefb6108. This is attempt 1: this message will repeat every 5th retry.
I20260429 08:00:47.428602 3027 consensus_queue.cc:1048] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260429 08:00:47.432000 1805 consensus_peers.cc:597] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30 -> Peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Couldn't send request to peer 873f2b4fab6f42738b2d41b4608a592a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e64aac0f06e454898f6622c9486ccec. This is attempt 1: this message will repeat every 5th retry.
I20260429 08:00:47.528821 3215 consensus_queue.cc:1048] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:47.792922 3224 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd076a6196ef424a813003c9c5d53d42)
I20260429 08:00:47.793053 3224 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:47.793406 3224 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:47.794584 3073 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:47.794739 3073 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:47.794796 3073 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:47.794934 3224 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260429 08:00:47.798132 3228 ts_tablet_manager.cc:933] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a: Initiating tablet copy from peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:47.798599 3228 tablet_copy_client.cc:323] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Beginning tablet copy session from remote peer at address 127.1.14.1:40803
I20260429 08:00:47.799297 1751 tablet_copy_service.cc:140] P 6441a846e67a46159cef1413b6d06337: Received BeginTabletCopySession request for tablet aecf5920885d49e0b8388a79eefb6108 from peer 873f2b4fab6f42738b2d41b4608a592a ({username='slave'} at 127.1.14.3:57327)
I20260429 08:00:47.799435 1751 tablet_copy_service.cc:161] P 6441a846e67a46159cef1413b6d06337: Beginning new tablet copy session on tablet aecf5920885d49e0b8388a79eefb6108 from peer 873f2b4fab6f42738b2d41b4608a592a at {username='slave'} at 127.1.14.3:57327: session id = 873f2b4fab6f42738b2d41b4608a592a-aecf5920885d49e0b8388a79eefb6108
I20260429 08:00:47.800678 1751 tablet_copy_source_session.cc:215] T aecf5920885d49e0b8388a79eefb6108 P 6441a846e67a46159cef1413b6d06337: Tablet Copy: opened 0 blocks and 1 log segments
I20260429 08:00:47.801977 3228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aecf5920885d49e0b8388a79eefb6108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:47.803680 3228 tablet_copy_client.cc:806] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Starting download of 0 data blocks...
I20260429 08:00:47.803874 3228 tablet_copy_client.cc:670] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Starting download of 1 WAL segments...
I20260429 08:00:47.805435 3228 tablet_copy_client.cc:538] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260429 08:00:47.805903 3230 ts_tablet_manager.cc:933] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a: Initiating tablet copy from peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:47.806203 3230 tablet_copy_client.cc:323] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Beginning tablet copy session from remote peer at address 127.1.14.1:40803
I20260429 08:00:47.806618 1751 tablet_copy_service.cc:140] P 6441a846e67a46159cef1413b6d06337: Received BeginTabletCopySession request for tablet d89c55601ea74fc3939db290586ce05a from peer 873f2b4fab6f42738b2d41b4608a592a ({username='slave'} at 127.1.14.3:57327)
I20260429 08:00:47.806710 1751 tablet_copy_service.cc:161] P 6441a846e67a46159cef1413b6d06337: Beginning new tablet copy session on tablet d89c55601ea74fc3939db290586ce05a from peer 873f2b4fab6f42738b2d41b4608a592a at {username='slave'} at 127.1.14.3:57327: session id = 873f2b4fab6f42738b2d41b4608a592a-d89c55601ea74fc3939db290586ce05a
I20260429 08:00:47.806921 3228 tablet_bootstrap.cc:492] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:47.807459 1751 tablet_copy_source_session.cc:215] T d89c55601ea74fc3939db290586ce05a P 6441a846e67a46159cef1413b6d06337: Tablet Copy: opened 0 blocks and 1 log segments
I20260429 08:00:47.808027 3230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89c55601ea74fc3939db290586ce05a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:47.809494 3230 tablet_copy_client.cc:806] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Starting download of 0 data blocks...
I20260429 08:00:47.809674 3230 tablet_copy_client.cc:670] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Starting download of 1 WAL segments...
I20260429 08:00:47.810371 3228 tablet_bootstrap.cc:492] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 08:00:47.810622 3228 tablet_bootstrap.cc:492] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap complete.
I20260429 08:00:47.810652 3230 tablet_copy_client.cc:538] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260429 08:00:47.810761 3228 ts_tablet_manager.cc:1403] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260429 08:00:47.811280 3228 raft_consensus.cc:359] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:47.811367 3228 raft_consensus.cc:740] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:47.811497 3228 consensus_queue.cc:260] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:47.811609 3230 tablet_bootstrap.cc:492] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:47.811779 3228 ts_tablet_manager.cc:1434] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:47.813025 1751 tablet_copy_service.cc:342] P 6441a846e67a46159cef1413b6d06337: Request end of tablet copy session 873f2b4fab6f42738b2d41b4608a592a-aecf5920885d49e0b8388a79eefb6108 received from {username='slave'} at 127.1.14.3:57327
I20260429 08:00:47.813129 1751 tablet_copy_service.cc:434] P 6441a846e67a46159cef1413b6d06337: ending tablet copy session 873f2b4fab6f42738b2d41b4608a592a-aecf5920885d49e0b8388a79eefb6108 on tablet aecf5920885d49e0b8388a79eefb6108 with peer 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:47.815977 3230 tablet_bootstrap.cc:492] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 08:00:47.816143 3230 tablet_bootstrap.cc:492] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap complete.
I20260429 08:00:47.816242 3230 ts_tablet_manager.cc:1403] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260429 08:00:47.816547 3230 raft_consensus.cc:359] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:47.816677 3230 raft_consensus.cc:740] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:47.816784 3230 consensus_queue.cc:260] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:47.817040 3230 ts_tablet_manager.cc:1434] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260429 08:00:47.817483 1751 tablet_copy_service.cc:342] P 6441a846e67a46159cef1413b6d06337: Request end of tablet copy session 873f2b4fab6f42738b2d41b4608a592a-d89c55601ea74fc3939db290586ce05a received from {username='slave'} at 127.1.14.3:57327
I20260429 08:00:47.817544 1751 tablet_copy_service.cc:434] P 6441a846e67a46159cef1413b6d06337: ending tablet copy session 873f2b4fab6f42738b2d41b4608a592a-d89c55601ea74fc3939db290586ce05a on tablet d89c55601ea74fc3939db290586ce05a with peer 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:47.871738 3004 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:00:47.871870 3004 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:47.872361 3004 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:00:47.872933 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:00:47.873036 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:00:47.873140 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:47.873263 3004 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:47.910671 3004 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:00:47.910768 3004 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:47.911154 3004 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:00:47.911738 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:00:47.911871 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:00:47.911949 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:47.912086 3004 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:47.929630 3230 ts_tablet_manager.cc:933] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a: Initiating tablet copy from peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:47.929942 3230 tablet_copy_client.cc:323] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Beginning tablet copy session from remote peer at address 127.1.14.2:43223
I20260429 08:00:47.930493 1889 tablet_copy_service.cc:140] P 353e59f343974ee68738535fb9029d30: Received BeginTabletCopySession request for tablet 5e64aac0f06e454898f6622c9486ccec from peer 873f2b4fab6f42738b2d41b4608a592a ({username='slave'} at 127.1.14.3:58127)
I20260429 08:00:47.930634 1889 tablet_copy_service.cc:161] P 353e59f343974ee68738535fb9029d30: Beginning new tablet copy session on tablet 5e64aac0f06e454898f6622c9486ccec from peer 873f2b4fab6f42738b2d41b4608a592a at {username='slave'} at 127.1.14.3:58127: session id = 873f2b4fab6f42738b2d41b4608a592a-5e64aac0f06e454898f6622c9486ccec
I20260429 08:00:47.931908 1889 tablet_copy_source_session.cc:215] T 5e64aac0f06e454898f6622c9486ccec P 353e59f343974ee68738535fb9029d30: Tablet Copy: opened 0 blocks and 1 log segments
I20260429 08:00:47.932992 3230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e64aac0f06e454898f6622c9486ccec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:47.934629 3230 tablet_copy_client.cc:806] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Starting download of 0 data blocks...
I20260429 08:00:47.934784 3230 tablet_copy_client.cc:670] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Starting download of 1 WAL segments...
I20260429 08:00:47.936074 3230 tablet_copy_client.cc:538] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260429 08:00:47.936993 3230 tablet_bootstrap.cc:492] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:47.939383 3230 tablet_bootstrap.cc:492] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 08:00:47.939553 3230 tablet_bootstrap.cc:492] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap complete.
I20260429 08:00:47.939680 3230 ts_tablet_manager.cc:1403] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260429 08:00:47.940043 3230 raft_consensus.cc:359] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:47.940131 3230 raft_consensus.cc:740] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:47.940274 3230 consensus_queue.cc:260] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:47.940557 3230 ts_tablet_manager.cc:1434] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:47.941185 1889 tablet_copy_service.cc:342] P 353e59f343974ee68738535fb9029d30: Request end of tablet copy session 873f2b4fab6f42738b2d41b4608a592a-5e64aac0f06e454898f6622c9486ccec received from {username='slave'} at 127.1.14.3:58127
I20260429 08:00:47.941278 1889 tablet_copy_service.cc:434] P 353e59f343974ee68738535fb9029d30: ending tablet copy session 873f2b4fab6f42738b2d41b4608a592a-5e64aac0f06e454898f6622c9486ccec on tablet 5e64aac0f06e454898f6622c9486ccec with peer 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:48.169600 3004 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:00:48.169719 3004 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:48.170171 3004 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:00:48.170791 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:00:48.170881 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:00:48.170989 1939 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:48.171137 3004 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:48.262261 3004 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:00:48.262481 3004 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:48.263005 3004 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:00:48.263671 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:00:48.263796 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:00:48.263837 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:48.263957 3004 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:48.286649 2004 raft_consensus.cc:1217] T aecf5920885d49e0b8388a79eefb6108 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260429 08:00:48.319852 2004 raft_consensus.cc:1217] T d89c55601ea74fc3939db290586ce05a P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260429 08:00:48.445354 2004 raft_consensus.cc:1217] T 5e64aac0f06e454898f6622c9486ccec P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260429 08:00:48.553242 1080 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task0BSNFf/build/debug/bin/kudu with pid 3055
I20260429 08:00:49.056083 3243 raft_consensus.cc:493] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:49.056218 3243 raft_consensus.cc:515] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:49.056703 3243 leader_election.cc:290] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:49.057034 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664e479f600745dc99596f4bc469dcaa" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337" is_pre_election: true
I20260429 08:00:49.057181 1729 raft_consensus.cc:2468] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 1.
W20260429 08:00:49.057235 1805 leader_election.cc:343] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Not found: Tablet not found: 664e479f600745dc99596f4bc469dcaa
I20260429 08:00:49.057431 1803 leader_election.cc:304] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters: 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:49.057601 3243 raft_consensus.cc:2804] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260429 08:00:49.057659 3243 raft_consensus.cc:493] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:49.057699 3243 raft_consensus.cc:3060] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 1 FOLLOWER]: Advancing to term 2
I20260429 08:00:49.058506 3243 raft_consensus.cc:515] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:49.058843 3243 leader_election.cc:290] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 2 election: Requested vote from peers 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:49.059175 1729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "664e479f600745dc99596f4bc469dcaa" candidate_uuid: "353e59f343974ee68738535fb9029d30" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6441a846e67a46159cef1413b6d06337"
I20260429 08:00:49.059299 1729 raft_consensus.cc:3060] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 1 FOLLOWER]: Advancing to term 2
W20260429 08:00:49.059351 1805 leader_election.cc:343] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Not found: Tablet not found: 664e479f600745dc99596f4bc469dcaa
I20260429 08:00:49.060109 1729 raft_consensus.cc:2468] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 353e59f343974ee68738535fb9029d30 in term 2.
I20260429 08:00:49.060393 1803 leader_election.cc:304] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337; no voters: 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:49.060539 3243 raft_consensus.cc:2804] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 2 FOLLOWER]: Leader election won for term 2
I20260429 08:00:49.060750 3243 raft_consensus.cc:697] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [term 2 LEADER]: Becoming Leader. State: Replica: 353e59f343974ee68738535fb9029d30, State: Running, Role: LEADER
I20260429 08:00:49.060906 3243 consensus_queue.cc:237] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:49.424098 3004 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:00:49.424208 3004 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:49.424597 3004 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:00:49.425158 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:00:49.425261 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:00:49.425323 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:49.425475 3004 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:49.426292 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.61:33847
--webserver_interface=127.1.14.61
--webserver_port=38285
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260429 08:00:49.486052 1805 consensus_peers.cc:597] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 -> Peer 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279): Couldn't send request to peer 873f2b4fab6f42738b2d41b4608a592a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 664e479f600745dc99596f4bc469dcaa. This is attempt 1: this message will repeat every 5th retry.
W20260429 08:00:49.524524 3255 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:49.524714 3255 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:49.524751 3255 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:49.528194 3255 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 08:00:49.528273 3255 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:49.528313 3255 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 08:00:49.528362 3255 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 08:00:49.532172 3255 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.61:33847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.14.61
--webserver_port=38285
--never_fsync=true
--heap_profile_path=/tmp/kudu.3255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:49.533155 3255 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:49.534122 3255 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:49.539026 3262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:49.539089 3263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:49.539059 3265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:49.539203 3255 server_base.cc:1061] running on GCE node
I20260429 08:00:49.539628 3255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:49.540475 3255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:49.541627 3255 hybrid_clock.cc:648] HybridClock initialized: now 1777449649541590 us; error 45 us; skew 500 ppm
I20260429 08:00:49.543434 3255 webserver.cc:492] Webserver started at http://127.1.14.61:38285/ using document root <none> and password file <none>
I20260429 08:00:49.543975 3255 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:49.544031 3255 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:49.547258 3255 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:49.549131 3271 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:49.549965 3255 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:49.550097 3255 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
uuid: "f1e6af049ae04c6e98cb5e609f9be472"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:49.550457 3255 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:49.569350 3255 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:49.569924 3255 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:49.570103 3255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:49.576181 3255 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.61:33847
I20260429 08:00:49.576193 3324 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.61:33847 every 8 connection(s)
I20260429 08:00:49.577227 3255 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
I20260429 08:00:49.580744 3325 sys_catalog.cc:263] Verifying existing consensus state
I20260429 08:00:49.581432 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 3255
I20260429 08:00:49.582484 3325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Bootstrap starting.
I20260429 08:00:49.592664 3325 log.cc:826] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:49.640672 3325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Bootstrap replayed 1/1 log segments. Stats: ops{read=103 overwritten=1 applied=102 ignored=0} inserts{seen=61 ignored=0} mutations{seen=89 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 08:00:49.641089 3325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Bootstrap complete.
I20260429 08:00:49.643630 3325 raft_consensus.cc:359] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:49.643975 3325 raft_consensus.cc:740] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1e6af049ae04c6e98cb5e609f9be472, State: Initialized, Role: FOLLOWER
I20260429 08:00:49.644387 3325 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 102, Last appended: 8.102, Last appended by leader: 102, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:49.644852 3329 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:49.644951 3329 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:49.645433 3325 sys_catalog.cc:565] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: configured and running, proceeding with master startup.
I20260429 08:00:49.650029 3255 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:00:49.652041 3255 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:49.652716 3343 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:49.652822 3343 catalog_manager.cc:1562] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: loading cluster ID for follower catalog manager: success
I20260429 08:00:49.655521 3343 catalog_manager.cc:1584] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: acquiring CA information for follower catalog manager: success
I20260429 08:00:49.657114 3343 catalog_manager.cc:1612] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260429 08:00:49.666301 1729 raft_consensus.cc:1275] T 664e479f600745dc99596f4bc469dcaa P 6441a846e67a46159cef1413b6d06337 [term 2 FOLLOWER]: Refusing update from remote peer 353e59f343974ee68738535fb9029d30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260429 08:00:49.666702 3243 consensus_queue.cc:1048] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260429 08:00:49.673915 1779 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:49.675226 1917 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:49.675706 3289 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6441a846e67a46159cef1413b6d06337" instance_seqno: 1777449628680786) as {username='slave'} at 127.1.14.1:42123; Asking this server to re-register.
I20260429 08:00:49.676321 3289 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "353e59f343974ee68738535fb9029d30" instance_seqno: 1777449628847581) as {username='slave'} at 127.1.14.2:55015; Asking this server to re-register.
I20260429 08:00:49.676996 1917 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:49.677003 1779 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:49.678215 3289 ts_manager.cc:194] Registered new tserver with Master: 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:49.678300 3288 ts_manager.cc:194] Registered new tserver with Master: 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:49.863476 3353 ts_tablet_manager.cc:933] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a: Initiating tablet copy from peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:49.863912 3353 tablet_copy_client.cc:323] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Beginning tablet copy session from remote peer at address 127.1.14.2:43223
I20260429 08:00:49.864396 3257 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:00:49.864404 1889 tablet_copy_service.cc:140] P 353e59f343974ee68738535fb9029d30: Received BeginTabletCopySession request for tablet 664e479f600745dc99596f4bc469dcaa from peer 873f2b4fab6f42738b2d41b4608a592a ({username='slave'} at 127.1.14.3:58127)
I20260429 08:00:49.864487 1889 tablet_copy_service.cc:161] P 353e59f343974ee68738535fb9029d30: Beginning new tablet copy session on tablet 664e479f600745dc99596f4bc469dcaa from peer 873f2b4fab6f42738b2d41b4608a592a at {username='slave'} at 127.1.14.3:58127: session id = 873f2b4fab6f42738b2d41b4608a592a-664e479f600745dc99596f4bc469dcaa
I20260429 08:00:49.864483 3257 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:49.864854 3257 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:49.865434 1889 tablet_copy_source_session.cc:215] T 664e479f600745dc99596f4bc469dcaa P 353e59f343974ee68738535fb9029d30: Tablet Copy: opened 0 blocks and 1 log segments
W20260429 08:00:49.865598 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:00:49.866022 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:00:49.866117 1939 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:49.866266 3257 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:49.866313 3353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 664e479f600745dc99596f4bc469dcaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260429 08:00:49.867874 3353 tablet_copy_client.cc:806] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Starting download of 0 data blocks...
I20260429 08:00:49.868059 3353 tablet_copy_client.cc:670] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Starting download of 1 WAL segments...
I20260429 08:00:49.869344 3353 tablet_copy_client.cc:538] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260429 08:00:49.870659 3353 tablet_bootstrap.cc:492] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap starting.
I20260429 08:00:49.873705 3353 tablet_bootstrap.cc:492] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 08:00:49.873914 3353 tablet_bootstrap.cc:492] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a: Bootstrap complete.
I20260429 08:00:49.874025 3353 ts_tablet_manager.cc:1403] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20260429 08:00:49.874368 3353 raft_consensus.cc:359] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:49.874451 3353 raft_consensus.cc:740] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 873f2b4fab6f42738b2d41b4608a592a, State: Initialized, Role: FOLLOWER
I20260429 08:00:49.874584 3353 consensus_queue.cc:260] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } }
I20260429 08:00:49.874907 3353 ts_tablet_manager.cc:1434] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260429 08:00:49.875509 1889 tablet_copy_service.cc:342] P 353e59f343974ee68738535fb9029d30: Request end of tablet copy session 873f2b4fab6f42738b2d41b4608a592a-664e479f600745dc99596f4bc469dcaa received from {username='slave'} at 127.1.14.3:58127
I20260429 08:00:49.875583 1889 tablet_copy_service.cc:434] P 353e59f343974ee68738535fb9029d30: ending tablet copy session 873f2b4fab6f42738b2d41b4608a592a-664e479f600745dc99596f4bc469dcaa on tablet 664e479f600745dc99596f4bc469dcaa with peer 873f2b4fab6f42738b2d41b4608a592a
I20260429 08:00:49.878840 2053 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:49.879752 3288 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" instance_seqno: 1777449629023571) as {username='slave'} at 127.1.14.3:52763; Asking this server to re-register.
I20260429 08:00:49.880142 2053 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:49.881045 3288 ts_manager.cc:194] Registered new tserver with Master: 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:50.036077 3329 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:50.036273 3329 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:50.037410 3329 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:50.037858 3275 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:50.038674 3275 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:50.038811 3275 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:50.038861 3275 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:50.039067 3329 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260429 08:00:50.080057 3257 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:00:50.080166 3257 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:50.080552 3257 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:00:50.081136 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:00:50.081212 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:00:50.081269 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:50.081501 3257 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:50.311710 2004 raft_consensus.cc:1217] T 664e479f600745dc99596f4bc469dcaa P 873f2b4fab6f42738b2d41b4608a592a [term 2 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[2.1-2.1] Dedup: 2.1->[]
I20260429 08:00:50.492491 3257 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:00:50.492661 3257 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:50.493158 3257 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:00:50.493793 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:00:50.494033 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:00:50.494100 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:50.494277 3257 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:50.539563 3358 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:50.539680 3358 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:50.540167 3358 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:50.541239 3275 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:50.541409 3275 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:50.541455 3275 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:50.541589 3358 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260429 08:00:51.297649 3367 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:51.297757 3367 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:51.298082 3367 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:51.299374 3275 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:51.299515 3275 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:51.299576 3275 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:51.299723 3367 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260429 08:00:51.850805 3257 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:00:51.850937 3257 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:51.851287 3257 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:00:51.851895 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:00:51.851992 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:00:51.852100 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:51.852291 3257 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:52.054948 3257 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:00:52.055075 3257 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:52.055586 3257 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:00:52.056115 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:00:52.056191 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:00:52.056236 1938 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:52.056354 3257 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:52.270434 3381 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:52.270594 3381 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:52.270958 3381 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:52.272140 3275 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:52.272284 3275 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:52.272333 3275 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:52.272480 3381 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260429 08:00:52.510192 3257 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:00:52.510344 3257 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:52.510764 3257 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:00:52.511417 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:00:52.511512 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:00:52.511629 1938 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:52.511777 3257 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:52.712491 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.60:41737
--webserver_interface=127.1.14.60
--webserver_port=45447
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260429 08:00:52.741293 3257 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:00:52.741403 3257 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:52.741844 3257 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:00:52.742460 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:00:52.742583 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:00:52.742671 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:52.742817 3257 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260429 08:00:52.807243 3390 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:52.807415 3390 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:52.807487 3390 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:52.810388 3390 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 08:00:52.810452 3390 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:52.810495 3390 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 08:00:52.810528 3390 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 08:00:52.814222 3390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.60:41737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.14.60
--webserver_port=45447
--never_fsync=true
--heap_profile_path=/tmp/kudu.3390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:52.815055 3390 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:52.816063 3390 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:52.821043 3398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:52.821043 3399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:52.821194 3401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:52.821636 3390 server_base.cc:1061] running on GCE node
I20260429 08:00:52.822103 3390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:52.822810 3390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:52.823957 3390 hybrid_clock.cc:648] HybridClock initialized: now 1777449652823927 us; error 38 us; skew 500 ppm
I20260429 08:00:52.825671 3390 webserver.cc:492] Webserver started at http://127.1.14.60:45447/ using document root <none> and password file <none>
I20260429 08:00:52.826184 3390 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:52.826236 3390 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:52.829265 3390 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260429 08:00:52.831027 3407 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:52.831888 3390 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:52.832006 3390 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
uuid: "cd076a6196ef424a813003c9c5d53d42"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:52.832353 3390 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:52.845727 3390 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:52.846227 3390 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:52.846421 3390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:52.853133 3390 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.60:41737
I20260429 08:00:52.853129 3459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.60:41737 every 8 connection(s)
I20260429 08:00:52.854269 3390 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-2/data/info.pb
I20260429 08:00:52.857586 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 3390
I20260429 08:00:52.858580 3460 sys_catalog.cc:263] Verifying existing consensus state
I20260429 08:00:52.860324 3460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Bootstrap starting.
I20260429 08:00:52.871225 3460 log.cc:826] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:52.917158 3460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Bootstrap replayed 1/1 log segments. Stats: ops{read=102 overwritten=0 applied=102 ignored=0} inserts{seen=61 ignored=0} mutations{seen=89 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 08:00:52.917541 3460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Bootstrap complete.
I20260429 08:00:52.920042 3460 raft_consensus.cc:359] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:52.920437 3460 raft_consensus.cc:740] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd076a6196ef424a813003c9c5d53d42, State: Initialized, Role: FOLLOWER
I20260429 08:00:52.920943 3460 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 102, Last appended: 8.102, Last appended by leader: 102, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:52.921342 3464 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:52.921458 3464 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:52.921917 3460 sys_catalog.cc:565] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: configured and running, proceeding with master startup.
I20260429 08:00:52.927495 3478 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:52.927560 3478 catalog_manager.cc:1562] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: loading cluster ID for follower catalog manager: success
I20260429 08:00:52.928064 3390 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:00:52.930004 3478 catalog_manager.cc:1584] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: acquiring CA information for follower catalog manager: success
I20260429 08:00:52.930073 3390 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:52.931383 3478 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260429 08:00:53.180984 1777 heartbeater.cc:344] Connected to a master server at 127.1.14.60:41737
I20260429 08:00:53.182719 3424 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6441a846e67a46159cef1413b6d06337" instance_seqno: 1777449628680786) as {username='slave'} at 127.1.14.1:36321; Asking this server to re-register.
I20260429 08:00:53.183244 1777 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:53.184434 3424 ts_manager.cc:194] Registered new tserver with Master: 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:53.321300 1915 heartbeater.cc:344] Connected to a master server at 127.1.14.60:41737
I20260429 08:00:53.322515 2051 heartbeater.cc:344] Connected to a master server at 127.1.14.60:41737
I20260429 08:00:53.322450 3424 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "353e59f343974ee68738535fb9029d30" instance_seqno: 1777449628847581) as {username='slave'} at 127.1.14.2:58761; Asking this server to re-register.
I20260429 08:00:53.323406 1915 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:53.323565 3424 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" instance_seqno: 1777449629023571) as {username='slave'} at 127.1.14.3:50827; Asking this server to re-register.
I20260429 08:00:53.324059 2051 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:53.324755 3424 ts_manager.cc:194] Registered new tserver with Master: 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:53.325382 3423 ts_manager.cc:194] Registered new tserver with Master: 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:53.382332 3464 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:53.382530 3464 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:53.383767 3464 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
W20260429 08:00:53.384253 3411 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:53.385118 3411 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:00:53.387565 3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd076a6196ef424a813003c9c5d53d42" candidate_term: 9 candidate_status { last_received { term: 8 index: 102 } } ignore_live_leader: false dest_uuid: "f1e6af049ae04c6e98cb5e609f9be472" is_pre_election: true
I20260429 08:00:53.387769 3299 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd076a6196ef424a813003c9c5d53d42 in term 8.
I20260429 08:00:53.388178 3408 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, f1e6af049ae04c6e98cb5e609f9be472; no voters: d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:53.388376 3464 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260429 08:00:53.388450 3464 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260429 08:00:53.388497 3464 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 8 FOLLOWER]: Advancing to term 9
I20260429 08:00:53.390079 3464 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:53.390374 3464 leader_election.cc:290] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 9 election: Requested vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), f1e6af049ae04c6e98cb5e609f9be472 (127.1.14.61:33847)
I20260429 08:00:53.390703 3299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cd076a6196ef424a813003c9c5d53d42" candidate_term: 9 candidate_status { last_received { term: 8 index: 102 } } ignore_live_leader: false dest_uuid: "f1e6af049ae04c6e98cb5e609f9be472"
I20260429 08:00:53.390854 3299 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 8 FOLLOWER]: Advancing to term 9
W20260429 08:00:53.391287 3411 leader_election.cc:336] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:00:53.392428 3299 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd076a6196ef424a813003c9c5d53d42 in term 9.
I20260429 08:00:53.392750 3408 leader_election.cc:304] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd076a6196ef424a813003c9c5d53d42, f1e6af049ae04c6e98cb5e609f9be472; no voters: d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:53.392902 3464 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 9 FOLLOWER]: Leader election won for term 9
I20260429 08:00:53.393126 3464 raft_consensus.cc:697] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [term 9 LEADER]: Becoming Leader. State: Replica: cd076a6196ef424a813003c9c5d53d42, State: Running, Role: LEADER
I20260429 08:00:53.393404 3464 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 8.102, Last appended by leader: 102, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:53.394948 3493 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd076a6196ef424a813003c9c5d53d42. Latest consensus state: current_term: 9 leader_uuid: "cd076a6196ef424a813003c9c5d53d42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:53.395054 3493 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42 [sys.catalog]: This master's current role is: LEADER
I20260429 08:00:53.395330 3495 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260429 08:00:53.396963 3495 catalog_manager.cc:679] Loaded metadata for table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07]
I20260429 08:00:53.397300 3495 catalog_manager.cc:679] Loaded metadata for table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e]
I20260429 08:00:53.397521 3495 catalog_manager.cc:679] Loaded metadata for table default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8]
I20260429 08:00:53.397797 3495 catalog_manager.cc:679] Loaded metadata for table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91]
I20260429 08:00:53.397984 3495 catalog_manager.cc:679] Loaded metadata for table default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156]
I20260429 08:00:53.398167 3495 catalog_manager.cc:679] Loaded metadata for table default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1]
I20260429 08:00:53.398352 3495 catalog_manager.cc:679] Loaded metadata for table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006]
I20260429 08:00:53.398553 3495 catalog_manager.cc:679] Loaded metadata for table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08]
I20260429 08:00:53.398748 3495 catalog_manager.cc:679] Loaded metadata for table default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3]
I20260429 08:00:53.398945 3495 catalog_manager.cc:679] Loaded metadata for table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2]
I20260429 08:00:53.399137 3495 catalog_manager.cc:679] Loaded metadata for table default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b]
I20260429 08:00:53.399326 3495 catalog_manager.cc:679] Loaded metadata for table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47]
I20260429 08:00:53.399515 3495 catalog_manager.cc:679] Loaded metadata for table default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b]
I20260429 08:00:53.399788 3495 catalog_manager.cc:679] Loaded metadata for table default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5]
I20260429 08:00:53.400802 3495 tablet_loader.cc:96] loaded metadata for tablet 0c763b359f5542888013123b2037b5d0 (table default.table_34261e3d16e14d888f3f3fd3c436b4ad [id=ba5133c5668141589469ba6e26f75c47])
I20260429 08:00:53.401508 3495 tablet_loader.cc:96] loaded metadata for tablet 4279160d7f8446109052951d62dcde1d (table default.table_2aa9e902a68149cebca957e279cc82c4 [id=8c3efbe07cdc40579fe7f3f193832006])
I20260429 08:00:53.401674 3495 tablet_loader.cc:96] loaded metadata for tablet 43def4d831db44c09e060f4949e6f8ac (table default.table_9f5b102f2ff746f39f84bc047bfb16c6 [id=d6ea842bf09f48afa629edccff01e16b])
I20260429 08:00:53.401854 3495 tablet_loader.cc:96] loaded metadata for tablet 50ab0c1c41f54389a6fd480da7026f20 (table default.table_09d20647c80a4575b1d220f120d4c58a [id=a833d1ad4ead437880cfb7d73a7dd00b])
I20260429 08:00:53.402102 3495 tablet_loader.cc:96] loaded metadata for tablet 5a2349526fb740f4b9c964cb9ecef4d6 (table default.table_3b6223798dcd434c989986f1d5727b55 [id=e3686089ce534efaaa9cc84eb588a4d5])
I20260429 08:00:53.402256 3495 tablet_loader.cc:96] loaded metadata for tablet 5e64aac0f06e454898f6622c9486ccec (table default.table_c566aa86e5284b17bb9bf76547b211f3 [id=77e01a7bd9df443390b71b28cd2ad156])
I20260429 08:00:53.402410 3495 tablet_loader.cc:96] loaded metadata for tablet 664e479f600745dc99596f4bc469dcaa (table default.table_03bb29fc9f854e85b7fc52f6523c6db0 [id=8ec0fa88b9c645e1aa026d8e57ee5a08])
I20260429 08:00:53.402647 3495 tablet_loader.cc:96] loaded metadata for tablet 6fed5cc1d4c045408c1b3342e8baba02 (table default.table_f3a21eb41add4d9abf6e559c2a1ebe9a [id=43f8b9c7990542d39c679d80b77db9c8])
I20260429 08:00:53.402874 3495 tablet_loader.cc:96] loaded metadata for tablet 881e1249f58b4480ad5940e69ee49788 (table default.table_6795420cac01458198a3bf0876fd6092 [id=a4ed989a19884204881820516d9704c3])
I20260429 08:00:53.403096 3495 tablet_loader.cc:96] loaded metadata for tablet 93630bad9fdd46e9b982cd1b44665433 (table default.table_ec6b6e2df1d545c78484235081b96327 [id=378948ee2c1540f68e35f3249e863a7e])
I20260429 08:00:53.403254 3495 tablet_loader.cc:96] loaded metadata for tablet 9622269e5988486a87b443646bf894cf (table default.table_00c8e8b0543b48458c08b780734269c6 [id=22977f026381472a97eeaf0d3112fa07])
I20260429 08:00:53.403723 3495 tablet_loader.cc:96] loaded metadata for tablet aecf5920885d49e0b8388a79eefb6108 (table default.table_91fe24cd92b444e1bd97440b6e584816 [id=85f2230320084f08a7b147f7efd77ed1])
I20260429 08:00:53.403904 3495 tablet_loader.cc:96] loaded metadata for tablet aefbf6a8d8b14de6965475a82ba5c9c4 (table default.table_99b9b733ad5c4a149389412905245938 [id=a7b78c42cfef44fcafe72b4f588505c2])
I20260429 08:00:53.404389 3495 tablet_loader.cc:96] loaded metadata for tablet d89c55601ea74fc3939db290586ce05a (table default.table_a3cf45aaf37c4ddf9ed00173d7c72a4c [id=7642795dd6414b8eaf42383b571d3f91])
I20260429 08:00:53.404772 3495 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260429 08:00:53.405262 3495 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:53.405331 3495 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260429 08:00:53.405977 3495 catalog_manager.cc:1514] Loading token signing keys...
I20260429 08:00:53.406497 3495 catalog_manager.cc:6055] T 00000000000000000000000000000000 P cd076a6196ef424a813003c9c5d53d42: Loaded TSK: 0
I20260429 08:00:53.406999 3495 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260429 08:00:53.407482 3495 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260429 08:00:53.408093 3495 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 20
I20260429 08:00:53.434104 3424 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55422:
name: "default.Table_eec10405ada64deba7b1528381398882"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:53.434267 3420 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55422:
name: "default.Table_baf66e1ed64348eda0d85f89019f9f49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:53.434120 3423 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55422:
name: "default.Table_7d22f9579cdc49118b40da3544eeee0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:53.434566 3422 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55422:
name: "default.Table_ba60f2d687a9431288851fb68b310758"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:53.434782 3415 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55422:
table { table_name: "default.Table_6795420cac01458198a3bf0876fd6092" } new_table_name: "default.Table_7d633f7b157e487daf0b0a993a8a71bc" modify_external_catalogs: true
I20260429 08:00:53.435050 3417 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55422:
table { table_name: "default.Table_2aa9e902a68149cebca957e279cc82c4" } modify_external_catalogs: true
I20260429 08:00:53.435158 3417 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55422:
table { table_name: "default.Table_2aa9e902a68149cebca957e279cc82c4" } modify_external_catalogs: true
I20260429 08:00:53.435333 3416 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55422:
table { table_name: "default.Table_99b9b733ad5c4a149389412905245938" } new_table_name: "default.Table_e2b4380a107742eab4f7945356ff2a2b" modify_external_catalogs: true
I20260429 08:00:53.435492 3418 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55422:
name: "default.Table_1f3eaa53e74241cc830474cdcc774f87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:53.435309 3419 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55422:
name: "default.Table_cc83324222db4bf980b1244fe6100d93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260429 08:00:53.434798 3421 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55422:
name: "default.Table_e71df0e290ff44a1b6d66b910af211c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260429 08:00:53.439684 3477 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 23, previous 23; dumping first 4 out of 13 received events: NotificationEvent(eventId=21, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_207de250815e4c1793355de8d028abec, message={"server":"","servicePrincipal":"","db":"default","table":"table_207de250815e4c1793355de8d028abec","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_207de250815e4c1793355de8d028abec\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_207de250815e4c1793355de8d028abec\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_207de250815e4c1793355de8d028abec\",\"kudu.table_id\":\"76db81fc69b8490d98c0496a830d00c2\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=22, eventTime=1777449632, eventType=CREATE_TABLE, dbName=default, tableName=table_91fe24cd92b444e1bd97440b6e584816, message={"server":"","servicePrincipal":"","db":"default","table":"table_91fe24cd92b444e1bd97440b6e584816","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_91fe24cd92b444e1bd97440b6e584816\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449632},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_91fe24cd92b444e1bd97440b6e584816\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_91fe24cd92b444e1bd97440b6e584816\",\"kudu.table_id\":\"85f2230320084f08a7b147f7efd77ed1\",\"transient_lastDdlTime\":\"1777449632\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_34261e3d16e14d888f3f3fd3c436b4ad, message={"server":"","servicePrincipal":"","db":"default","table":"table_34261e3d16e14d888f3f3fd3c436b4ad","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449630},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_34261e3d16e14d888f3f3fd3c436b4ad\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_34261e3d16e14d888f3f3fd3c436b4ad\",\"kudu.table_id\":\"ba5133c5668141589469ba6e26f75c47\",\"transient_lastDdlTime\":\"1777449630\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=23, eventTime=1777449632, eventType=DROP_TABLE, dbName=default, tableName=table_012320bc4c054b62be2e415bca912daf, message={"server":"","servicePrincipal":"","db":"default","table":"table_012320bc4c054b62be2e415bca912daf","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_012320bc4c054b62be2e415bca912daf\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1777449631},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/warehouse/table_012320bc4c054b62be2e415bca912daf\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_012320bc4c054b62be2e415bca912daf\",\"kudu.table_id\":\"038ee5f1404b4d3ca452c21bfa0253e6\",\"transient_lastDdlTime\":\"1777449631\",\"comment\":\"\",\"kudu.master_addresses\":\"127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"8931d09def2d44d791c8bd1aafd25ad2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1777449632}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f4f7db42dcd google::LogMessage::Fail() at ??:0
@ 0x7f4f7db46b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f4f7db427cc google::LogMessage::Flush() at ??:0
@ 0x7f4f7db42a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7f4f830b6433 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f4f830b534a kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f4f830b4aad _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
@ 0x7f4f830ba1b4 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x56167e653244 std::function<>::operator()() at ??:0
@ 0x7f4f7f0477ea kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4f7f98c6db start_thread at ??:0
@ 0x7f4f7ccf961f clone at ??:0
W20260429 08:00:53.611302 2061 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.1.14.60:41737)
W20260429 08:00:53.611613 2061 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.1.14.60:41737)
W20260429 08:00:53.611723 2061 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.14.60:41737)
W20260429 08:00:53.612172 2061 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.1.14.60:41737)
I20260429 08:00:54.652904 3255 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:00:54.653028 3255 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:55.055524 3513 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:00:55.055639 3513 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:55.056058 3513 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:00:55.056711 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:00:55.056797 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:00:55.056866 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:55.056995 3513 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:55.116845 3513 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:00:55.116979 3513 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:55.117466 3513 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:00:55.118132 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:00:55.118274 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:00:55.118381 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:55.118561 3513 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:55.186204 1080 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task0BSNFf/build/debug/bin/kudu with pid 3255
I20260429 08:00:55.993724 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.61:33847
--webserver_interface=127.1.14.61
--webserver_port=38285
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260429 08:00:56.092486 3519 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:56.092873 3519 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:56.092969 3519 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:56.096091 3519 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 08:00:56.096136 3519 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:56.096160 3519 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 08:00:56.096235 3519 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 08:00:56.099766 3519 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.61:33847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.14.61
--webserver_port=38285
--never_fsync=true
--heap_profile_path=/tmp/kudu.3519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:56.100622 3519 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:56.101554 3519 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:56.106446 3526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:56.106462 3525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:56.106447 3528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:56.106735 3519 server_base.cc:1061] running on GCE node
I20260429 08:00:56.107234 3519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:56.107996 3519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:56.109186 3519 hybrid_clock.cc:648] HybridClock initialized: now 1777449656109167 us; error 32 us; skew 500 ppm
I20260429 08:00:56.110764 3519 webserver.cc:492] Webserver started at http://127.1.14.61:38285/ using document root <none> and password file <none>
I20260429 08:00:56.111423 3519 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:56.111534 3519 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:56.114799 3519 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260429 08:00:56.116672 3534 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:56.117551 3519 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260429 08:00:56.117673 3519 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
uuid: "f1e6af049ae04c6e98cb5e609f9be472"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:56.118010 3519 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:56.137202 3519 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:56.137770 3519 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:56.137979 3519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:56.144821 3519 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.61:33847
I20260429 08:00:56.144838 3586 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.61:33847 every 8 connection(s)
I20260429 08:00:56.145787 3519 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
I20260429 08:00:56.149477 3587 sys_catalog.cc:263] Verifying existing consensus state
I20260429 08:00:56.149495 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 3519
I20260429 08:00:56.151258 3587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Bootstrap starting.
I20260429 08:00:56.163552 3587 log.cc:826] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:56.200245 1779 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:56.214881 3587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Bootstrap replayed 1/1 log segments. Stats: ops{read=103 overwritten=1 applied=102 ignored=0} inserts{seen=61 ignored=0} mutations{seen=89 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 08:00:56.215220 3587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Bootstrap complete.
I20260429 08:00:56.218004 3587 raft_consensus.cc:359] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:56.218317 3587 raft_consensus.cc:740] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1e6af049ae04c6e98cb5e609f9be472, State: Initialized, Role: FOLLOWER
I20260429 08:00:56.218662 3587 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 102, Last appended: 8.102, Last appended by leader: 102, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:56.219053 3592 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:56.219185 3592 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:56.219647 3587 sys_catalog.cc:565] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: configured and running, proceeding with master startup.
I20260429 08:00:56.225847 3606 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:56.225958 3606 catalog_manager.cc:1562] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: loading cluster ID for follower catalog manager: success
I20260429 08:00:56.224443 3519 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:00:56.226473 3519 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:56.228590 3606 catalog_manager.cc:1584] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: acquiring CA information for follower catalog manager: success
I20260429 08:00:56.230175 3606 catalog_manager.cc:1612] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260429 08:00:56.329023 1917 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:56.329929 3513 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:00:56.330034 3513 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:56.330400 3513 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:56.330734 3551 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "353e59f343974ee68738535fb9029d30" instance_seqno: 1777449628847581) as {username='slave'} at 127.1.14.2:48801; Asking this server to re-register.
W20260429 08:00:56.331074 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:00:56.331444 1917 heartbeater.cc:461] Registering TS with master...
W20260429 08:00:56.331492 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:00:56.331571 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:56.331741 3513 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:56.332871 2053 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:56.333362 3550 ts_manager.cc:194] Registered new tserver with Master: 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:56.333930 3551 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" instance_seqno: 1777449629023571) as {username='slave'} at 127.1.14.3:48031; Asking this server to re-register.
I20260429 08:00:56.334619 2053 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:56.335850 3551 ts_manager.cc:194] Registered new tserver with Master: 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:00:56.686622 3592 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:56.686818 3592 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:56.688114 3592 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:56.688644 3538 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:56.689428 3538 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:56.689594 3538 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:56.689656 3538 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:56.689841 3592 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:00:56.702982 3551 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6441a846e67a46159cef1413b6d06337" instance_seqno: 1777449628680786) as {username='slave'} at 127.1.14.1:43371; Asking this server to re-register.
I20260429 08:00:56.703382 1779 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:56.704290 3551 ts_manager.cc:194] Registered new tserver with Master: 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:00:56.758656 3520 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:00:56.758785 3520 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:56.759148 3520 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:00:56.759887 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:00:56.759985 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:00:56.760057 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:56.760221 3520 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:57.377918 3617 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:57.378031 3617 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:57.378391 3617 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:57.379715 3538 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:57.379850 3538 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:57.379895 3538 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:57.380026 3617 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:00:58.174232 3520 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:00:58.174338 3520 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:00:58.174749 3520 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:00:58.175390 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:00:58.175498 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:00:58.175551 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:00:58.175674 3520 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:00:58.413308 3625 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:00:58.413436 3625 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:58.413828 3625 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:00:58.415364 3538 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:00:58.415450 3538 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:00:58.415481 3538 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:00:58.415623 3625 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:00:58.596144 1080 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task0BSNFf/build/debug/bin/kudu with pid 3519
I20260429 08:00:59.538703 1080 external_mini_cluster.cc:1366] Running /tmp/dist-test-task0BSNFf/build/debug/bin/kudu
/tmp/dist-test-task0BSNFf/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.61:33847
--webserver_interface=127.1.14.61
--webserver_port=38285
--builtin_ntp_servers=127.1.14.20:34305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260429 08:00:59.632725 3634 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260429 08:00:59.632891 3634 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260429 08:00:59.632929 3634 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260429 08:00:59.635977 3634 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260429 08:00:59.636023 3634 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260429 08:00:59.636041 3634 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260429 08:00:59.636098 3634 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260429 08:00:59.639441 3634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.14.20:34305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:38259
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.14.61:33847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.14.61
--webserver_port=38285
--never_fsync=true
--heap_profile_path=/tmp/kudu.3634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 80f39681e127423fa66f8c177be6c05697ac70dd
build type DEBUG
built by None at 29 Apr 2026 07:43:14 UTC on bdcb31816ec0
build id 11656
I20260429 08:00:59.640234 3634 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260429 08:00:59.641116 3634 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260429 08:00:59.645778 3639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:59.645855 3634 server_base.cc:1061] running on GCE node
W20260429 08:00:59.645800 3640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260429 08:00:59.646136 3642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260429 08:00:59.646543 3634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260429 08:00:59.647264 3634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260429 08:00:59.648427 3634 hybrid_clock.cc:648] HybridClock initialized: now 1777449659648408 us; error 36 us; skew 500 ppm
I20260429 08:00:59.650141 3634 webserver.cc:492] Webserver started at http://127.1.14.61:38285/ using document root <none> and password file <none>
I20260429 08:00:59.650632 3634 fs_manager.cc:362] Metadata directory not provided
I20260429 08:00:59.650728 3634 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260429 08:00:59.653394 3634 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260429 08:00:59.655124 3648 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260429 08:00:59.656097 3634 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260429 08:00:59.656217 3634 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data,/tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
uuid: "f1e6af049ae04c6e98cb5e609f9be472"
format_stamp: "Formatted at 2026-04-29 08:00:27 on dist-test-slave-lllb"
I20260429 08:00:59.656529 3634 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260429 08:00:59.685743 3634 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260429 08:00:59.686281 3634 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260429 08:00:59.686473 3634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260429 08:00:59.693610 3634 rpc_server.cc:307] RPC server started. Bound to: 127.1.14.61:33847
I20260429 08:00:59.693621 3700 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.14.61:33847 every 8 connection(s)
I20260429 08:00:59.694770 3634 server_base.cc:1193] Dumped server information to /tmp/dist-test-task0BSNFf/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1777449612478614-1080-0/minicluster-data/master-1/data/info.pb
I20260429 08:00:59.699085 3701 sys_catalog.cc:263] Verifying existing consensus state
I20260429 08:00:59.700467 3701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Bootstrap starting.
I20260429 08:00:59.703940 1080 external_mini_cluster.cc:1428] Started /tmp/dist-test-task0BSNFf/build/debug/bin/kudu as pid 3634
I20260429 08:00:59.711397 3701 log.cc:826] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Log is configured to *not* fsync() on all Append() calls
I20260429 08:00:59.716281 1779 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:59.761801 3701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Bootstrap replayed 1/1 log segments. Stats: ops{read=103 overwritten=1 applied=102 ignored=0} inserts{seen=61 ignored=0} mutations{seen=89 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260429 08:00:59.762177 3701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: Bootstrap complete.
I20260429 08:00:59.764843 3701 raft_consensus.cc:359] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:59.765214 3701 raft_consensus.cc:740] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1e6af049ae04c6e98cb5e609f9be472, State: Initialized, Role: FOLLOWER
I20260429 08:00:59.765758 3701 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 102, Last appended: 8.102, Last appended by leader: 102, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:00:59.766604 3706 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } } }
I20260429 08:00:59.766844 3706 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: This master's current role is: FOLLOWER
I20260429 08:00:59.766952 3701 sys_catalog.cc:565] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [sys.catalog]: configured and running, proceeding with master startup.
I20260429 08:00:59.771337 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:00:59.773150 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:00:59.774487 3720 catalog_manager.cc:1269] Loaded cluster ID: 8931d09def2d44d791c8bd1aafd25ad2
I20260429 08:00:59.774580 3720 catalog_manager.cc:1562] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: loading cluster ID for follower catalog manager: success
I20260429 08:00:59.777050 3720 catalog_manager.cc:1584] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: acquiring CA information for follower catalog manager: success
I20260429 08:00:59.778520 3720 catalog_manager.cc:1612] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260429 08:00:59.846666 1917 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:59.847934 3662 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "353e59f343974ee68738535fb9029d30" instance_seqno: 1777449628847581) as {username='slave'} at 127.1.14.2:54519; Asking this server to re-register.
I20260429 08:00:59.848189 2053 heartbeater.cc:344] Connected to a master server at 127.1.14.61:33847
I20260429 08:00:59.848805 1917 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:59.849150 3662 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" instance_seqno: 1777449629023571) as {username='slave'} at 127.1.14.3:53711; Asking this server to re-register.
I20260429 08:00:59.849507 2053 heartbeater.cc:461] Registering TS with master...
I20260429 08:00:59.850176 3662 ts_manager.cc:194] Registered new tserver with Master: 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
I20260429 08:00:59.850453 3665 ts_manager.cc:194] Registered new tserver with Master: 873f2b4fab6f42738b2d41b4608a592a (127.1.14.3:33279)
I20260429 08:01:00.218932 3665 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6441a846e67a46159cef1413b6d06337" instance_seqno: 1777449628680786) as {username='slave'} at 127.1.14.1:36151; Asking this server to re-register.
I20260429 08:01:00.219364 1779 heartbeater.cc:461] Registering TS with master...
I20260429 08:01:00.220331 3665 ts_manager.cc:194] Registered new tserver with Master: 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
I20260429 08:01:00.263479 3520 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:01:00.263640 3520 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:00.264123 3520 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:01:00.264923 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:01:00.265111 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:01:00.265214 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:00.265408 3520 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:00.342718 3725 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:01:00.342881 3725 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:01:00.343997 3725 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:01:00.344596 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:01:00.345490 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:01:00.345672 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:01:00.345733 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:01:00.345960 3725 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:01:01.037565 3730 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:01:01.037670 3730 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:01:01.038100 3730 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:01:01.039475 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:01:01.039588 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:01:01.039642 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:01:01.039827 3730 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:01:01.997903 3520 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:01.998023 3520 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:01.998502 3520 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:01:01.999143 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:01:01.999253 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:01:01.999308 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:01.999487 3520 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:02.079226 3738 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:01:02.079334 3738 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:01:02.079705 3738 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:01:02.080996 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:01:02.081157 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:01:02.081208 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:01:02.081370 3738 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:01:02.210960 1080 master-stress-test.cc:577] Killing test thread 1/25
I20260429 08:01:02.707648 3744 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:01:02.707746 3744 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:01:02.708153 3744 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:01:02.709299 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:01:02.709424 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:01:02.709465 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:01:02.709589 3744 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:01:03.464275 3520 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:03.464440 3520 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:03.465122 3520 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:01:03.465843 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:01:03.466013 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:01:03.466073 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:03.466248 3520 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:03.959770 3756 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:01:03.959889 3756 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:01:03.960374 3756 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:01:03.961443 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:01:03.961521 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:01:03.961546 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:01:03.961695 3756 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:01:04.774036 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:01:04.774133 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:01:06.922308 3520 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:06.922430 3520 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:06.922853 3520 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:01:06.923532 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:01:06.923652 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:01:06.923744 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:06.923930 3520 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:07.549121 3778 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:01:07.549250 3778 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:01:07.549729 3778 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:01:07.550384 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260429 08:01:07.551177 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:01:07.551296 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:01:07.551349 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:01:07.551492 3778 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:01:08.848461 3520 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:08.848630 3520 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:08.849051 3520 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:01:08.849706 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:01:08.849785 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:01:08.849849 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:08.849973 3520 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:09.454941 3520 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:01:09.455093 3520 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:09.455503 3520 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:01:09.456349 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:01:09.456486 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:01:09.456625 1938 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:09.456790 3520 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:09.774925 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:01:09.775028 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:01:11.054430 3520 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:11.054533 3520 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:11.054908 3520 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:01:11.055521 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:01:11.055620 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:01:11.055718 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:11.055895 3520 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:11.582695 3805 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:01:11.582842 3805 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:01:11.583254 3805 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:01:11.584367 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:01:11.584481 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:01:11.584527 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:01:11.584686 3805 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:01:13.901080 3520 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:13.901178 3520 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:13.901536 3520 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:01:13.902052 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:01:13.902179 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:01:13.902266 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:13.902413 3520 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:14.776028 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:01:14.776156 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:01:17.002445 3520 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:17.002578 3520 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:17.003099 3520 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:01:17.003633 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:01:17.003723 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:01:17.003815 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:17.003976 3520 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:19.623752 3893 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:01:19.623893 3893 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:01:19.624432 3893 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:01:19.625006 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260429 08:01:19.625737 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:01:19.625854 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:01:19.625906 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:01:19.626037 3893 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:01:19.777086 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:01:19.777248 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:01:23.294826 3941 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:01:23.294967 3941 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:01:23.295392 3941 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:01:23.296820 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:01:23.296944 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:01:23.297021 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:01:23.297168 3941 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:01:23.315585 3911 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:01:23.315768 3911 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:23.316351 3911 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:01:23.317255 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:01:23.317360 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:01:23.317474 1938 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:23.317696 3911 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:23.581751 3911 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:23.581897 3911 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:23.582283 3911 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:01:23.582894 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:01:23.582979 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:01:23.583019 1938 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:23.583181 3911 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:24.778476 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:01:24.778611 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:01:27.714520 3911 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:27.714695 3911 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:27.715200 3911 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:01:27.715935 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:01:27.716037 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:01:27.716123 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:27.716259 3911 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260429 08:01:29.243796 1777 heartbeater.cc:646] Failed to heartbeat to 127.1.14.60:41737 (71 consecutive failures): Network error: Failed to ping master at 127.1.14.60:41737: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
W20260429 08:01:29.394716 1916 heartbeater.cc:646] Failed to heartbeat to 127.1.14.62:41885 (114 consecutive failures): Network error: Failed to ping master at 127.1.14.62:41885: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:01:29.613691 3911 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:29.613858 3911 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:29.614413 3911 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:01:29.615144 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:01:29.615239 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:01:29.615335 1939 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:29.615463 3911 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:29.779847 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:01:29.779992 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260429 08:01:29.895850 2051 heartbeater.cc:646] Failed to heartbeat to 127.1.14.60:41737 (72 consecutive failures): Network error: Failed to ping master at 127.1.14.60:41737: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:01:31.269567 3911 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:31.269721 3911 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:31.270159 3911 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:01:31.270814 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:01:31.271003 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:01:31.271080 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:31.271189 3911 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:33.457029 4060 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:01:33.457163 4060 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:33.457553 4060 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:01:33.458132 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:01:33.458233 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:01:33.458295 1938 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:33.458418 4060 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:34.781157 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:01:34.781311 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:01:36.137660 4101 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:01:36.137799 4101 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:01:36.138170 4101 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:01:36.138828 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260429 08:01:36.139683 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:01:36.139871 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:01:36.139919 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:01:36.140075 4101 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:01:36.404110 4087 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:36.404279 4087 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:36.404752 4087 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:01:36.405435 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:01:36.405535 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:01:36.405644 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:36.405794 4087 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:39.782313 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:01:39.782434 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:01:40.380903 4128 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:40.381103 4128 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:40.381783 4128 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:01:40.382601 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:01:40.382699 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:01:40.382759 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:40.382879 4128 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:41.789605 4128 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:41.789758 4128 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:41.790215 4128 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:01:41.790910 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:01:41.791049 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:01:41.791121 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:41.791244 4128 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:42.579936 4128 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:42.580098 4128 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:42.580534 4128 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:01:42.581303 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:01:42.581395 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:01:42.581501 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:42.581676 4128 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:44.783391 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:01:44.783529 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:01:49.784610 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:01:49.784734 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:01:51.537519 4297 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:01:51.537673 4297 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:01:51.538283 4297 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:01:51.539031 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260429 08:01:51.539820 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:01:51.539953 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:01:51.540014 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:01:51.540149 4297 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:01:53.214582 4285 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:01:53.214743 4285 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:53.215253 4285 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:01:53.215862 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:01:53.215969 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:01:53.216018 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:53.216166 4285 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:54.018743 4285 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:54.018922 4285 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:54.019441 4285 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:01:54.020234 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:01:54.020323 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:01:54.020432 1939 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:54.020618 4285 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:54.785851 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:01:54.785989 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:01:57.306727 4285 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:57.306846 4285 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:57.307312 4285 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:01:57.307965 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:01:57.308045 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:01:57.308089 1938 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:57.308212 4285 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:59.710047 4285 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:01:59.710173 4285 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:01:59.710570 4285 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:01:59.711412 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:01:59.711504 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:01:59.711607 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:01:59.711800 4285 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:01:59.790050 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:01:59.790166 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:02:01.101135 4418 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:02:01.101246 4418 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:02:01.101708 4418 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:02:01.102211 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260429 08:02:01.102787 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:02:01.102900 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:02:01.102957 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:02:01.103101 4418 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:02:02.965804 4285 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:02.965920 4285 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:02.966342 4285 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:02:02.966924 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:02:02.967001 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:02:02.967057 1939 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:02.967182 4285 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:04.791224 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:02:04.791340 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:02:06.421648 4285 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:02:06.421808 4285 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:06.422278 4285 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:06.422875 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:02:06.422978 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:02:06.423112 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:06.423273 4285 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:07.944851 4285 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:07.945019 4285 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:07.945437 4285 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:02:07.946113 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:02:07.946214 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:02:07.946285 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:07.946432 4285 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:09.792235 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:02:09.792380 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:02:11.475996 4513 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:11.476115 4513 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:11.476622 4513 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:11.477264 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:02:11.477380 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:02:11.477471 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:11.477633 4513 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:12.383738 4513 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:12.383891 4513 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:12.384632 4513 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:02:12.385430 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:02:12.385535 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:02:12.385596 1939 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:12.385740 4513 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:12.495432 4513 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:12.495535 4513 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:12.495864 4513 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:02:12.496412 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:02:12.496546 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:02:12.496670 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:12.496810 4513 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:13.367475 4573 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:02:13.367584 4573 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:02:13.368096 4573 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:02:13.368686 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260429 08:02:13.369386 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:02:13.369501 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:02:13.369541 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:02:13.369661 4573 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:02:13.743328 4513 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:02:13.743443 4513 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:13.743762 4513 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:13.744388 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:02:13.744470 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:02:13.744509 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:13.744690 4513 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:14.793368 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:02:14.793494 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:02:15.886216 4605 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:02:15.886348 4605 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:02:15.886821 4605 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:02:15.887858 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:02:15.887975 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:02:15.888016 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:02:15.888139 4605 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:02:17.801357 4513 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:17.801477 4513 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:17.801774 4513 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:02:17.802441 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:02:17.802524 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:02:17.802564 1939 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:17.802760 4513 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:19.794377 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:02:19.794503 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:02:24.795513 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:02:24.795671 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:02:26.254175 4681 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:26.254357 4681 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:26.254945 4681 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:26.255693 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:02:26.255802 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:02:26.255919 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:26.256064 4681 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260429 08:02:29.366271 1777 heartbeater.cc:646] Failed to heartbeat to 127.1.14.60:41737 (191 consecutive failures): Network error: Failed to ping master at 127.1.14.60:41737: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:02:29.433262 4772 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:02:29.433387 4772 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:02:29.433773 4772 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:02:29.434419 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260429 08:02:29.435186 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:02:29.435298 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:02:29.435355 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:02:29.435470 4772 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260429 08:02:29.527609 1915 heartbeater.cc:646] Failed to heartbeat to 127.1.14.60:41737 (191 consecutive failures): Network error: Failed to ping master at 127.1.14.60:41737: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:02:29.796638 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:02:29.796783 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:02:30.014331 4681 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:02:30.014465 4681 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:30.015048 4681 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:30.015805 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:02:30.015918 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:02:30.015967 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:30.016103 4681 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260429 08:02:30.029006 2052 heartbeater.cc:646] Failed to heartbeat to 127.1.14.62:41885 (232 consecutive failures): Network error: Failed to ping master at 127.1.14.62:41885: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:02:30.619114 4681 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:30.619249 4681 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:30.619752 4681 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:02:30.620615 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:02:30.620712 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:02:30.620821 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:30.620992 4681 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:30.803949 4681 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:30.804060 4681 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:30.804510 4681 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:02:30.805079 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:02:30.805305 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:02:30.805370 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:30.805545 4681 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:31.535641 4803 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:02:31.535780 4803 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:02:31.536198 4803 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:02:31.537485 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:02:31.537616 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:02:31.537650 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:02:31.537782 4803 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:02:33.917562 4829 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:02:33.917704 4829 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:33.918234 4829 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:33.919029 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:02:33.919162 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:02:33.919250 1938 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:33.919416 4829 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:34.797879 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:02:34.798022 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:02:37.754408 4847 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:37.754590 4847 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:37.755035 4847 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:37.755939 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:02:37.756073 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:02:37.756160 1938 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:37.756307 4847 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:39.799152 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:02:39.799270 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:02:40.500029 4900 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:40.500190 4900 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:40.500730 4900 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:02:40.501384 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:02:40.501507 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:02:40.501596 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:40.501778 4900 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:40.760903 4900 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:02:40.761031 4900 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:40.761441 4900 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:40.762035 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:02:40.762223 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:02:40.762315 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:40.762486 4900 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:40.905496 4900 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:40.905649 4900 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:40.906097 4900 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:40.906773 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:02:40.906845 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:02:40.906896 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:40.907061 4900 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:41.704751 4930 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:02:41.704877 4930 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:02:41.705304 4930 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:02:41.705865 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260429 08:02:41.706619 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:02:41.706732 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:02:41.706780 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:02:41.706905 4930 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:02:42.469622 4900 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:42.469746 4900 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:42.470237 4900 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:02:42.470916 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:02:42.471143 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:02:42.471241 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:42.471422 4900 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:44.270263 4945 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:44.270413 4945 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:44.270812 4945 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:44.271559 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:02:44.271710 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:02:44.271801 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:44.271960 4945 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:44.800420 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:02:44.800568 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:02:45.449749 4945 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:45.449893 4945 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:45.450546 4945 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:02:45.451292 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:02:45.451388 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:02:45.451514 1939 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:45.451687 4945 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:49.801784 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:02:49.801918 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:02:50.349753 5038 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:50.349944 5038 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:50.350452 5038 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:50.351272 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:02:50.351369 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:02:50.351436 1938 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:50.351586 5038 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:53.354700 5075 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:02:53.354826 5075 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:02:53.355185 5075 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:02:53.355901 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260429 08:02:53.356842 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:02:53.356979 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:02:53.357023 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:02:53.357146 5075 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:02:54.133589 5038 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:54.133721 5038 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:54.134130 5038 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:54.134862 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:02:54.134948 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:02:54.135062 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:54.135249 5038 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:54.802914 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:02:54.803036 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:02:55.676879 5038 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:55.677040 5038 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:55.677455 5038 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:55.678027 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:02:55.678122 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:02:55.678242 1938 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:55.678421 5038 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:55.918640 5038 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:55.918841 5038 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:55.919359 5038 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:02:55.920163 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:02:55.920344 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:02:55.920444 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:55.920640 5038 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:57.171442 5115 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:02:57.171577 5115 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:57.172097 5115 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:02:57.172816 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:02:57.172914 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:02:57.173031 1938 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:57.173187 5115 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:57.180637 5115 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:02:57.180769 5115 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:02:57.181180 5115 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:02:57.181824 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:02:57.181951 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:02:57.182036 1939 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:02:57.182212 5115 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:02:58.010816 5139 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:02:58.010943 5139 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:02:58.011428 5139 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:02:58.012969 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:02:58.013101 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:02:58.013146 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:02:58.013288 5139 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:02:59.804171 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:02:59.804289 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:02:59.838805 3654 maintenance_manager.cc:419] P f1e6af049ae04c6e98cb5e609f9be472: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033353
I20260429 08:02:59.873773 3653 maintenance_manager.cc:643] P f1e6af049ae04c6e98cb5e609f9be472: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.034s user 0.014s sys 0.005s Metrics: {"bytes_written":22051,"cfile_init":1,"dirs.queue_time_us":216,"dirs.run_cpu_time_us":178,"dirs.run_wall_time_us":736,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":504,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":54,"thread_start_us":225,"threads_started":2,"wal-append.queue_time_us":161}
I20260429 08:02:59.874557 3654 maintenance_manager.cc:419] P f1e6af049ae04c6e98cb5e609f9be472: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3775 bytes on disk
I20260429 08:02:59.875077 3653 maintenance_manager.cc:643] P f1e6af049ae04c6e98cb5e609f9be472: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4}
I20260429 08:03:00.361713 5115 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:00.361871 5115 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:00.362287 5115 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:03:00.362988 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:03:00.363081 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:03:00.363137 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:00.363265 5115 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:01.134756 5196 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:03:01.134862 5196 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:03:01.135248 5196 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:03:01.135800 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260429 08:03:01.136502 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:03:01.136648 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:03:01.136706 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:03:01.136816 5196 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:03:04.805408 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:03:04.805533 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:03:06.776188 5219 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:06.776324 5219 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:06.776904 5219 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:03:06.777649 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:03:06.777741 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:03:06.777858 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:06.778023 5219 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:08.383402 5219 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:03:08.383544 5219 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:08.383983 5219 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:03:08.384646 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:03:08.384783 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:03:08.384878 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:08.385047 5219 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:09.408803 5310 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:09.408942 5310 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:09.409360 5310 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:03:09.410019 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:03:09.410095 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:03:09.410142 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:09.410290 5310 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:09.806556 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:03:09.806663 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:03:14.759662 5310 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:14.759835 5310 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:14.760351 5310 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:03:14.761020 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:03:14.761111 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:03:14.761221 1938 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:14.761436 5310 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:14.807777 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:03:14.807929 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:03:14.828033 5417 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:03:14.828145 5417 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:03:14.828543 5417 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:03:14.829161 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260429 08:03:14.829892 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:03:14.830008 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:03:14.830078 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:03:14.830204 5417 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:03:15.243717 5310 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:03:15.243851 5310 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:15.244329 5310 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:03:15.245079 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:03:15.245199 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:03:15.245308 1938 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:15.245508 5310 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:15.371253 5310 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:15.371414 5310 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:15.371946 5310 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:03:15.372785 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:03:15.372926 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:03:15.373015 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:15.373201 5310 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:19.152170 5310 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:19.152314 5310 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:19.152757 5310 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:03:19.153388 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:03:19.153501 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:03:19.153600 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:19.153740 5310 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:19.809003 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:03:19.809156 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:03:21.568424 5310 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:03:21.568553 5310 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:21.569104 5310 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:03:21.569777 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:03:21.569875 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:03:21.569986 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:21.570123 5310 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:22.906209 5310 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:22.906345 5310 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:22.906941 5310 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:03:22.907585 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:03:22.907721 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:03:22.907810 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:22.907986 5310 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:24.812798 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:03:24.812932 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:03:25.452665 5585 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:03:25.452807 5585 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:03:25.453279 5585 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:03:25.453890 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260429 08:03:25.454545 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:03:25.454670 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:03:25.454733 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:03:25.454882 5585 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:03:28.596345 5310 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:28.596472 5310 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:28.596953 5310 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:03:28.597637 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:03:28.597806 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:03:28.597890 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:28.598034 5310 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260429 08:03:29.492051 1777 heartbeater.cc:646] Failed to heartbeat to 127.1.14.60:41737 (311 consecutive failures): Network error: Failed to ping master at 127.1.14.60:41737: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
W20260429 08:03:29.662004 1915 heartbeater.cc:646] Failed to heartbeat to 127.1.14.60:41737 (311 consecutive failures): Network error: Failed to ping master at 127.1.14.60:41737: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:03:29.814049 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:03:29.814188 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260429 08:03:30.163311 2052 heartbeater.cc:646] Failed to heartbeat to 127.1.14.62:41885 (352 consecutive failures): Network error: Failed to ping master at 127.1.14.62:41885: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:03:34.815239 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:03:34.815382 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:03:35.007481 5730 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:35.007612 5730 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:35.008082 5730 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:03:35.008806 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:03:35.008893 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:03:35.009006 1939 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:35.009166 5730 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:36.486052 5730 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:36.486217 5730 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:36.486714 5730 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:03:36.487480 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:03:36.487558 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:03:36.487600 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:36.487726 5730 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:39.816787 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:03:39.816943 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:03:40.005106 5730 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:03:40.005230 5730 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:40.005658 5730 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:03:40.006399 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:03:40.006484 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:03:40.006523 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:40.006698 5730 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:40.856736 5730 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:40.856932 5730 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:40.857364 5730 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:03:40.858136 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:03:40.858220 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:03:40.858317 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:40.858477 5730 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:41.874258 5730 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:41.874382 5730 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:41.874748 5730 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:03:41.875335 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:03:41.875422 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:03:41.875486 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:41.875641 5730 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:42.427248 5730 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:03:42.427376 5730 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:42.427733 5730 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:03:42.428261 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:03:42.428355 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:03:42.428460 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:42.428606 5730 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:43.872845 5880 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:03:43.873006 5880 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:03:43.873508 5880 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:03:43.874090 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260429 08:03:43.874779 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:03:43.874897 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:03:43.874939 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:03:43.875079 5880 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:03:44.818001 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:03:44.818140 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:03:46.666623 5730 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:03:46.666754 5730 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:46.667277 5730 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:03:46.668044 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:03:46.668128 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:03:46.668238 1938 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:46.668366 5730 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:47.331974 5730 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:47.332149 5730 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:47.332679 5730 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:03:47.333348 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:03:47.333448 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:03:47.333560 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:47.333716 5730 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:48.681770 5730 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:48.681895 5730 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:48.682374 5730 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:03:48.682967 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:03:48.683085 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:03:48.683171 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:48.683321 5730 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:49.819335 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:03:49.819470 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:03:50.252415 5977 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:03:50.252624 5977 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:03:50.253141 5977 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:03:50.253646 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:03:50.253798 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:03:50.253886 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:03:50.254002 5977 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:03:54.820354 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:03:54.820477 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:03:59.821841 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:03:59.821991 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:04:00.034866 6088 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:00.035050 6088 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:00.035656 6088 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:04:00.036396 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:04:00.036478 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:04:00.036545 1939 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:00.036716 6088 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:00.649190 6088 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:00.649355 6088 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:00.649755 6088 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:04:00.650431 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:04:00.650529 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:04:00.650596 1938 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:00.650774 6088 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:01.549693 6160 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:04:01.549844 6160 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:04:01.550360 6160 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:04:01.551054 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260429 08:04:01.551874 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:04:01.551992 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:04:01.552052 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:04:01.552197 6160 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:04:02.029546 6088 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:02.029670 6088 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:02.030150 6088 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:04:02.030758 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:04:02.030843 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:04:02.030900 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:02.031071 6088 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:03.429775 6088 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:04:03.429888 6088 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:03.430205 6088 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:04:03.430759 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:04:03.430851 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:04:03.430905 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:03.431023 6088 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:04.496073 6209 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:04:04.496191 6209 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:04:04.496685 6209 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:04:04.497795 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:04:04.497885 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:04:04.497911 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:04:04.498046 6209 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:04:04.822853 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:04:04.822984 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:04:07.787535 6088 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:07.787662 6088 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:07.788103 6088 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:04:07.788733 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:04:07.788866 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:04:07.788949 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:07.789100 6088 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:09.823942 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:04:09.824075 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:04:12.464869 6088 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:04:12.465003 6088 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:12.465353 6088 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:04:12.465982 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:04:12.466069 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:04:12.466143 1938 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:12.466270 6088 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:14.825057 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:04:14.825201 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:04:15.707316 6088 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:15.707451 6088 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:15.707940 6088 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:04:15.708691 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:04:15.708824 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:04:15.708889 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:15.709009 6088 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:16.017177 6088 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:16.017292 6088 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:16.017642 6088 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:04:16.018309 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:04:16.018422 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:04:16.018536 1938 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:16.018697 6088 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:17.390627 6412 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:04:17.390781 6412 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:04:17.391294 6412 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:04:17.391826 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260429 08:04:17.392709 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:04:17.392791 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:04:17.392850 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:04:17.392990 6412 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:04:17.548270 6088 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:17.548381 6088 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:17.548776 6088 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:04:17.549381 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:04:17.549496 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:04:17.549593 1938 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:17.549741 6088 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:18.599195 6088 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:18.599323 6088 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:18.599799 6088 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:04:18.600307 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:04:18.600415 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:04:18.600499 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:18.600638 6088 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:19.826709 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:04:19.826831 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:04:20.800765 6088 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:20.800909 6088 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:20.801339 6088 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:04:20.802069 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:04:20.802444 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:04:20.802531 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:20.802709 6088 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:21.152191 6466 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:04:21.152362 6466 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:04:21.152959 6466 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:04:21.154397 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:04:21.154539 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:04:21.154608 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:04:21.154747 6466 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:04:21.713790 6088 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:21.713939 6088 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:21.714342 6088 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:04:21.715015 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:04:21.715137 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:04:21.715214 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:21.715350 6088 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:21.721298 6088 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:21.721396 6088 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:21.721724 6088 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:04:21.722344 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:04:21.722440 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:04:21.722522 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:21.722659 6088 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:24.827939 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:04:24.828150 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:04:26.629717 6555 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:04:26.629869 6555 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:04:26.630313 6555 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:04:26.630888 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260429 08:04:26.631578 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:04:26.631688 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:04:26.631742 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:04:26.631853 6555 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260429 08:04:29.611991 1777 heartbeater.cc:646] Failed to heartbeat to 127.1.14.60:41737 (431 consecutive failures): Network error: Failed to ping master at 127.1.14.60:41737: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
W20260429 08:04:29.796536 1916 heartbeater.cc:646] Failed to heartbeat to 127.1.14.62:41885 (474 consecutive failures): Network error: Failed to ping master at 127.1.14.62:41885: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:04:29.829272 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:04:29.829393 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260429 08:04:30.297576 2052 heartbeater.cc:646] Failed to heartbeat to 127.1.14.62:41885 (472 consecutive failures): Network error: Failed to ping master at 127.1.14.62:41885: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:04:30.955287 6088 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:04:30.955480 6088 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:30.956049 6088 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:04:30.956769 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:04:30.956854 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:04:30.956943 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:30.957095 6088 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:32.772910 6649 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:04:32.773077 6649 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:04:32.773543 6649 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:04:32.774236 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260429 08:04:32.775032 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:04:32.775154 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:04:32.775231 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:04:32.775398 6649 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:04:34.830765 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:04:34.830868 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:04:35.063254 6088 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:35.063447 6088 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:35.063915 6088 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:04:35.064520 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:04:35.064615 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:04:35.064679 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:35.064795 6088 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:36.698060 6088 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:36.698197 6088 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:36.698593 6088 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:04:36.699126 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:04:36.699203 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:04:36.699327 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:36.699455 6088 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:38.006772 6088 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:38.006904 6088 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:38.007302 6088 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:04:38.008033 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:04:38.008138 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:04:38.008292 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:38.008426 6088 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:38.855890 6088 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:38.856017 6088 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:38.856474 6088 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:04:38.857098 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:04:38.857184 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:04:38.857296 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:38.857450 6088 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:39.831804 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:04:39.831928 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:04:40.253000 6088 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:40.253152 6088 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:40.253546 6088 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:04:40.254205 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:04:40.254355 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:04:40.254420 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:40.254592 6088 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:41.919384 6775 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:04:41.919529 6775 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:41.919919 6775 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:04:41.920467 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:04:41.920620 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:04:41.920701 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:41.920827 6775 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:44.833001 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:04:44.833156 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:04:48.607667 6775 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:48.607851 6775 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:48.608424 6775 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:04:48.609196 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:04:48.609282 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:04:48.609393 1939 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:48.609571 6775 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:49.584473 6775 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:04:49.584599 6775 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:49.584939 6775 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:04:49.585551 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:04:49.585675 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:04:49.585762 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:49.585891 6775 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:49.834183 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:04:49.834317 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:04:52.503568 6952 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:04:52.503710 6952 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:04:52.504189 6952 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:04:52.504899 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260429 08:04:52.505733 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:04:52.505857 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:04:52.505900 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:04:52.506013 6952 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:04:53.456523 6971 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:04:53.456709 6971 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:04:53.457063 6971 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:04:53.458470 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:04:53.458600 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:04:53.458642 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:04:53.458774 6971 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:04:54.835229 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:04:54.835343 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:04:56.381031 6958 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:56.381181 6958 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:56.381609 6958 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:04:56.382213 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:04:56.382295 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:04:56.382380 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:56.382498 6958 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:58.019157 6958 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:04:58.019291 6958 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:04:58.019737 6958 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:04:58.020381 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:04:58.020597 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:04:58.020684 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:04:58.020867 6958 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:04:59.836460 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:04:59.836616 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:05:00.884334 6958 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:05:00.884467 6958 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:00.884928 6958 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:05:00.885462 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:05:00.885552 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:05:00.885617 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:00.885766 6958 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:02.699766 7106 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:05:02.699931 7106 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:05:02.700325 7106 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:05:02.700877 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260429 08:05:02.701617 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:05:02.701719 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:05:02.701783 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:05:02.701941 7106 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:05:04.716895 7121 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:05:04.717000 7121 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:04.717571 7121 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:05:04.718034 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:05:04.718114 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:05:04.718173 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:04.718317 7121 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:04.837515 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:05:04.837631 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:05:08.691926 7155 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:05:08.692040 7155 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:08.692365 7155 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:05:08.692951 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:05:08.693055 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:05:08.693164 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:08.693296 7155 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:09.838613 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:05:09.838724 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:05:12.584072 7253 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:05:12.584192 7253 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:05:12.584666 7253 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:05:12.585276 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260429 08:05:12.586036 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:05:12.586140 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:05:12.586189 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:05:12.586344 7253 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:05:13.323649 7155 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:05:13.323770 7155 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:13.324244 7155 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:05:13.324900 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:05:13.325008 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:05:13.325103 1939 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:13.325238 7155 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:14.732936 7155 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:05:14.733057 7155 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:14.733652 7155 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:05:14.734109 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:05:14.734196 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:05:14.734288 1939 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:14.734441 7155 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:14.839906 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:05:14.840039 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:05:14.962553 7155 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:05:14.962684 7155 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:14.963112 7155 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:05:14.963723 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:05:14.963836 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:05:14.963946 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:14.964121 7155 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:16.793494 7155 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:05:16.793670 7155 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:16.794152 7155 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:05:16.794894 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:05:16.794981 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:05:16.795033 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:16.795161 7155 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:19.840983 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:05:19.841101 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:05:20.133482 7339 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:05:20.133592 7339 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:20.134025 7339 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:05:20.134531 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:05:20.134606 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:05:20.134649 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:20.134840 7339 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:21.718364 7386 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:05:21.718533 7386 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:05:21.718956 7386 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:05:21.719489 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260429 08:05:21.720203 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:05:21.720302 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:05:21.720345 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:05:21.720458 7386 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:05:22.346719 7379 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:05:22.346829 7379 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:22.347216 7379 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:05:22.347774 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:05:22.347864 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:05:22.347926 1938 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:22.348074 7379 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:24.348701 7430 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:05:24.348865 7430 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:05:24.349320 7430 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:05:24.350661 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:05:24.350780 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:05:24.350826 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:05:24.350996 7430 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:05:24.842022 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:05:24.842171 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:05:24.884922 7379 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:05:24.885062 7379 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:24.885521 7379 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:05:24.886098 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:05:24.886193 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:05:24.886252 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:24.886372 7379 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:25.590372 7379 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:05:25.590508 7379 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:25.590899 7379 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:05:25.591425 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:05:25.591581 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:05:25.591655 1938 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:25.591779 7379 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:27.110769 7379 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:05:27.110916 7379 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:27.111349 7379 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:05:27.112188 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:05:27.112286 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:05:27.112351 1938 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:27.112475 7379 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:27.476529 7379 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:05:27.476687 7379 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:27.477123 7379 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:05:27.477640 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:05:27.477733 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:05:27.477790 1938 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:27.477906 7379 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260429 08:05:29.727629 1777 heartbeater.cc:646] Failed to heartbeat to 127.1.14.60:41737 (551 consecutive failures): Network error: Failed to ping master at 127.1.14.60:41737: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:05:29.843143 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:05:29.843266 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260429 08:05:29.923000 1916 heartbeater.cc:646] Failed to heartbeat to 127.1.14.62:41885 (594 consecutive failures): Network error: Failed to ping master at 127.1.14.62:41885: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:05:30.423635 2052 heartbeater.cc:646] Failed to heartbeat to 127.1.14.62:41885 (592 consecutive failures): Network error: Failed to ping master at 127.1.14.62:41885: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
I20260429 08:05:34.613018 7495 raft_consensus.cc:493] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:05:34.613140 7495 raft_consensus.cc:515] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:34.613560 7495 leader_election.cc:290] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:05:34.614240 1938 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
W20260429 08:05:34.614338 1939 leader_election.cc:343] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3d4069c79e8f4c36ba414169bd049b8f
I20260429 08:05:34.614436 1939 leader_election.cc:304] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:34.614585 7495 raft_consensus.cc:2749] T 3d4069c79e8f4c36ba414169bd049b8f P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:34.844213 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:05:34.844326 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:05:36.471773 7612 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:05:36.471908 7612 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:05:36.472277 7612 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:05:36.472929 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260429 08:05:36.473632 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:05:36.473742 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:05:36.473790 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:05:36.473896 7612 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:05:38.042461 7495 raft_consensus.cc:493] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6441a846e67a46159cef1413b6d06337)
I20260429 08:05:38.042610 7495 raft_consensus.cc:515] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:38.043175 7495 leader_election.cc:290] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:05:38.043951 1939 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
W20260429 08:05:38.044036 1938 leader_election.cc:343] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: c1c2987616df4a438b5160e1fbc5387e
I20260429 08:05:38.044159 1938 leader_election.cc:304] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:38.044420 7495 raft_consensus.cc:2749] T c1c2987616df4a438b5160e1fbc5387e P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:39.313628 7647 raft_consensus.cc:493] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:05:39.313786 7647 raft_consensus.cc:515] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:39.314199 7647 leader_election.cc:290] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803), 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223)
W20260429 08:05:39.314896 1939 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
W20260429 08:05:39.315027 1938 leader_election.cc:343] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 3b29c11f78624a22922bae3070f194f3
I20260429 08:05:39.315136 1938 leader_election.cc:304] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:39.315287 7647 raft_consensus.cc:2749] T 3b29c11f78624a22922bae3070f194f3 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:39.845322 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:05:39.845479 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:05:42.501492 7647 raft_consensus.cc:493] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 353e59f343974ee68738535fb9029d30)
I20260429 08:05:42.501657 7647 raft_consensus.cc:515] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "353e59f343974ee68738535fb9029d30" member_type: VOTER last_known_addr { host: "127.1.14.2" port: 43223 } } peers { permanent_uuid: "6441a846e67a46159cef1413b6d06337" member_type: VOTER last_known_addr { host: "127.1.14.1" port: 40803 } } peers { permanent_uuid: "873f2b4fab6f42738b2d41b4608a592a" member_type: VOTER last_known_addr { host: "127.1.14.3" port: 33279 } }
I20260429 08:05:42.502113 7647 leader_election.cc:290] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223), 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803)
W20260429 08:05:42.502748 1939 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 353e59f343974ee68738535fb9029d30 (127.1.14.2:43223): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
W20260429 08:05:42.502880 1938 leader_election.cc:343] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6441a846e67a46159cef1413b6d06337 (127.1.14.1:40803): Not found: Tablet not found: 29d7fe3ebc3148a9be321460da8abdb5
I20260429 08:05:42.502970 1938 leader_election.cc:304] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 873f2b4fab6f42738b2d41b4608a592a; no voters: 353e59f343974ee68738535fb9029d30, 6441a846e67a46159cef1413b6d06337
I20260429 08:05:42.503147 7647 raft_consensus.cc:2749] T 29d7fe3ebc3148a9be321460da8abdb5 P 873f2b4fab6f42738b2d41b4608a592a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260429 08:05:43.791793 7722 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260429 08:05:43.791908 7722 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7c20d1745e54a9db1e0082a48ed06e4" member_type: VOTER last_known_addr { host: "127.1.14.62" port: 41885 } } peers { permanent_uuid: "f1e6af049ae04c6e98cb5e609f9be472" member_type: VOTER last_known_addr { host: "127.1.14.61" port: 33847 } } peers { permanent_uuid: "cd076a6196ef424a813003c9c5d53d42" member_type: VOTER last_known_addr { host: "127.1.14.60" port: 41737 } }
I20260429 08:05:43.792321 7722 leader_election.cc:290] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885), cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737)
W20260429 08:05:43.792992 3652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260429 08:05:43.794116 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7c20d1745e54a9db1e0082a48ed06e4 (127.1.14.62:41885): Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111)
W20260429 08:05:43.794239 3652 leader_election.cc:336] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer cd076a6196ef424a813003c9c5d53d42 (127.1.14.60:41737): Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
I20260429 08:05:43.794305 3652 leader_election.cc:304] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1e6af049ae04c6e98cb5e609f9be472; no voters: cd076a6196ef424a813003c9c5d53d42, d7c20d1745e54a9db1e0082a48ed06e4
I20260429 08:05:43.794473 7722 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f1e6af049ae04c6e98cb5e609f9be472 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260429 08:05:44.846613 3634 master_runner.cc:186] Error getting master registration for 127.1.14.62:41885: Network error: Client connection negotiation failed: client connection to 127.1.14.62:41885: connect: Connection refused (error 111),
I20260429 08:05:44.846750 3634 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260429 08:05:46.850538 3654 maintenance_manager.cc:419] P f1e6af049ae04c6e98cb5e609f9be472: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 3775 bytes on disk
I20260429 08:05:46.853544 3653 maintenance_manager.cc:643] P f1e6af049ae04c6e98cb5e609f9be472: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.003s user 0.002s sys 0.001s Metrics: {"dirs.queue_time_us":203,"thread_start_us":234,"threads_started":2,"wal-append.queue_time_us":162}
W20260429 08:05:47.226213 2058 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
W20260429 08:05:47.226410 2058 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
W20260429 08:05:47.226457 2058 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
W20260429 08:05:47.226540 2058 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
F20260429 08:05:47.237057 2065 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ba60f2d687a9431288851fb68b310758 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Aborted at 1777449947 (unix time) try "date -d @1777449947" if you are using GNU date ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240931 2088 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240931 2088 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241153 2079 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240931 2088 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241153 2079 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241262 2085 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240931 2088 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241153 2079 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241262 2085 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241385 2071 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_baf66e1ed64348eda0d85f89019f9f49 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240931 2088 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241153 2079 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241262 2085 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241385 2071 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_baf66e1ed64348eda0d85f89019f9f49 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241469 2069 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_eec10405ada64deba7b1528381398882 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240931 2088 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241153 2079 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241262 2085 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241385 2071 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_baf66e1ed64348eda0d85f89019f9f49 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241469 2069 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_eec10405ada64deba7b1528381398882 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.242244 2077 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800000438) received by PID 1080 (TID 0x7efc5b5c6700) from PID 1080; stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240931 2088 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241153 2079 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241262 2085 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241385 2071 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_baf66e1ed64348eda0d85f89019f9f49 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241469 2069 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_eec10405ada64deba7b1528381398882 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.242244 2077 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.243379 2087 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240931 2088 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241153 2079 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241262 2085 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241385 2071 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_baf66e1ed64348eda0d85f89019f9f49 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241469 2069 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_eec10405ada64deba7b1528381398882 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.242244 2077 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.243379 2087 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.243424 2066 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_012320bc4c054b62be2e415bca912daf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240931 2088 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241153 2079 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241262 2085 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241385 2071 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_baf66e1ed64348eda0d85f89019f9f49 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241469 2069 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_eec10405ada64deba7b1528381398882 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.242244 2077 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.243379 2087 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.243424 2066 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_012320bc4c054b62be2e415bca912daf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.244633 2078 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240931 2088 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241153 2079 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241262 2085 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241385 2071 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_baf66e1ed64348eda0d85f89019f9f49 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241469 2069 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_eec10405ada64deba7b1528381398882 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.242244 2077 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.243379 2087 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.243424 2066 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_012320bc4c054b62be2e415bca912daf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.244633 2078 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.244673 2086 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240931 2088 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241153 2079 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241262 2085 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241385 2071 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_baf66e1ed64348eda0d85f89019f9f49 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241469 2069 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_eec10405ada64deba7b1528381398882 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.242244 2077 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.243379 2087 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.243424 2066 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_012320bc4c054b62be2e415bca912daf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.244633 2078 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.244673 2086 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.244642 2074 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_cc83324222db4bf980b1244fe6100d93 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7efc6f42d980 (unknown) at ??:0
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240931 2088 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241153 2079 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241262 2085 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241385 2071 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_baf66e1ed64348eda0d85f89019f9f49 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241469 2069 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_eec10405ada64deba7b1528381398882 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.242244 2077 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.243379 2087 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.243424 2066 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_012320bc4c054b62be2e415bca912daf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.244633 2078 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.244673 2086 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.244642 2074 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_cc83324222db4bf980b1244fe6100d93 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.245818 2089 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260429 08:05:47.237087 2083Fmaster-stress-test.cc:2026297] 0429 8: 5:47.237118 Check failed: _s.ok() Bad status: 2075 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)ed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111) F20260429 08:05:47.238278 2073 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b1938a0ba6d9429ba63271d6f958a060 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.238312 2068 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e71df0e290ff44a1b6d66b910af211c0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239492 2084 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239593 2067 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7d22f9579cdc49118b40da3544eeee0e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239514 2070 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_207de250815e4c1793355de8d028abec on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.239625 2090 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240777 2082 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240809 2081 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240923 2076 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.240931 2088 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241153 2079 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241262 2085 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241385 2071 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_baf66e1ed64348eda0d85f89019f9f49 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.241469 2069 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_eec10405ada64deba7b1528381398882 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.242244 2077 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.243379 2087 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.243424 2066 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_012320bc4c054b62be2e415bca912daf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.244633 2078 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.244673 2086 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.244642 2074 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_cc83324222db4bf980b1244fe6100d93 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.245818 2089 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)F20260429 08:05:47.245891 2080 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.1.14.62:41885,127.1.14.61:33847,127.1.14.60:41737, num_attempts: 763) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.1.14.60:41737: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7efc6cfabe87 gsignal at ??:0
@ 0x7efc6cfad7f1 abort at ??:0
@ 0x7efc6de14dcd google::LogMessage::Fail() at ??:0
@ 0x7efc6de18b93 google::LogMessage::SendToLog() at ??:0
@ 0x7efc6de147cc google::LogMessage::Flush() at ??:0
@ 0x7efc6de15f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x55e4a0b719bd kudu::MasterStressTest::CreateTableThread() at ??:0
@ 0x55e4a0b846fc std::__invoke_impl<>() at ??:0
@ 0x55e4a0b82438 std::__invoke<>() at ??:0
@ 0x55e4a0b89a89 _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTcl8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at ??:0
@ 0x55e4a0b88a8d std::thread::_Invoker<>::operator()() at ??:0
@ 0x55e4a0b8780a std::thread::_State_impl<>::_M_run() at ??:0
@ 0x7efc6d6336df (unknown) at ??:0
@ 0x7efc6f4226db start_thread at ??:0
@ 0x7efc6d08e61f clone at ??:0